Azure Search

Azure Search is a search-as-a-service solution that allows developers to incorporate a sophisticated search experience into web and mobile applications without having to worry about the complexities of full-text search and without having to deploy, maintain or manage any infrastructure

How can we improve Azure Search?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Support picking existing index when creating an indexer in Azure Portal

    Today is only possible to create an indexer if you follow the entire process through import data workflow:

    -Select the data Source
    -Add Cognitive skills (optional)
    -Create an Index
    -Create an Indexer

    However, there are times we want to set a different schedule for an indexer or create a new one, without recreating the index.

    38 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      1 comment  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
    • Indexer priority

      We are using CosmosDb as our DB for apps search and we need to have overrides to change apps metadata on-the-fly. This allows us to hide some apps from clients or change privacy statements without the need for the developer to re-upload their work.

      To achieve this, we use a CosmosDb collection for the app data and another for the overrides.
      In order to provide our clients with search, we use Azure Search and to keep indexes up-to-date, we wanted to use Indexers.

      It is indeed possible at the present time to have multiple data sources get uploaded to the…

      3 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
      • 36 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
        • Use Webhooks after running an indexer

          It would be interesting if an indexer could use Webhooks to notify that it has finished indexing. In this way, for example, we can integrate it with Azure functions and avoid having to poll for the status of an Indexer that I have triggered.
          I'm working on an application that will create contents and place them in Blob Storage. An indexer will be executed and I would like to execute some searches once the indexing is done. It would be nice if the Indexer could notify a function (via a webhook) that it finished indexing in order to execute those…

          10 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            1 comment  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
          • Provide field mapping function to inject a constant value into the index

            I'm creating an index which is importing data from a SQL Server Database. I would like to add a field to the index whose value is just "OK" for every document. This field does not exist in the database and we do not want to add it there.
            Is it possible to add a hard-coded field to an Azure Search index which auto-populates with the given string (in this case, "OK") for all documents that get imported?

            11 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              need-feedback  ·  2 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
            • 28 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
              • Increase Blob Indexer file size limits

                The "Blob indexer: maximum characters of content extracted from a blob" limit seems rather restrictive, 32K for free, 64K for standard and 4MB for everything else. Plus when this limit is reached all you see in the azure portal is

                [{ "key": null, "message": "Truncated extracted text to 32768 characters." }]

                It'd be useful to know which documents are affected.

                7 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  2 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                • Indexer (crawler) for Apache Cassandra API in Azure Cosmos DB

                  Add an indexer/crawler for Apache Cassandra API in Azure Cosmos DB

                  12 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                  • Enable indexing of gzip compressed blobs

                    https://stackoverflow.com/questions/46245505/indexing-gzipped-blobs-in-azure-search

                    I am trying to setup Azure Search over Azure Blob. The json blobs are compressed using gzip.

                    When I try to index the blobs as-is, I get the exception :

                    "Error detecting index schema from data source: "Error processing blob https://mystorageaccount.blob.core.windows.net/mycontainer/urlencodedname with content type ''. Status:UnsupportedMediaType, error:""

                    Looks like Azure Search blob indexer does support indexing ZIP archives (application/zip MIME type), but not gzip-compressed files.

                    18 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      under review  ·  1 comment  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                    • Allow custom defined Field Mapping Function

                      Currently when defining the indexers, one can specify the field mappings from source to target fields. Only a limited set of functions such as Extract token at position etc are supported. It would be desirable to support Func syntax such that each row is passed onto the func which then decide the target field value based on developer defined logic in func.

                      Eg: we have a cosmo db source and a azure table storage data source. The partition key for cosmo db collection is combination of tenantId:studentId for efficient read/writes across partitions based on our data. The azure table storage…

                      15 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                      • Table Storage Indexing of multiple tables at scale

                        I believe that a good pattern for Azure Table Storage is to enable fast deletes by simply dropping tables. I've implemented a multi-tenant model for my data using a table per tenant, and would like to aggregate search data across tables.

                        The current recommendation is to create an indexer per table. This means the number of tenants I support (which I'm hoping to be in the thousands) is limited to the number of indexers I can create, which is a very low number.

                        The latest table storage SDK has methods to asynchronously list tables in a segmented fashion using continuation…

                        14 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                        • Support for indexing multi-line JSON files

                          Support for indexing multi-line JSON files (https://en.wikipedia.org/wiki/JSON_Streaming). Currently blob indexer extracts entire json file as one document.

                          It would be also nice to pair this with the gzip support so that it will be able to index *.json.gz files

                          3 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                          • allow indexers to call DocumentDB stored procedures

                            We have difficulty in transferring documents where we require multiple maps of our data into the flat search index. There is a limit of two user defined functions (which we use to do this) and there doesn't appear to be a way to call a stored procedure through the query language. Having the search indexers support DocumentDB stored procedures gives us far more power and flexibility to map the data correctly. At the moment we have had to revert back to writing our own code to do this.

                            19 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                            • Run multiple Indexers at once

                              We have many indexes with matching indexers that scan SQL Server tables to import/update data.

                              I found that during the initial import of a new large index (millions of records, taking several hours), none of the other indexers on the same service are run at all. This means that just by adding a new index, all other indexes will become stale until the large index is finished!

                              Please add the ability for multiple indexers to run simultaneously.

                              35 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                1 comment  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                              • support a mix of JSON and non-JSON blobs in the same data source

                                Support a mix of JSON and non-JSON blobs in the same data source

                                9 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                • Support indexing JSON-LD embedded in HTML documents

                                  Support indexing structured data (e.g. schema.org) in HTML documents.

                                  6 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                    0 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Add support for using Azure Data Lake with blob indexer or new indexer

                                    Customer would want to use ADL as a centralized store and then use various services like Azure Search, HDInsight on top of the same document store

                                    67 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                      5 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                    • Indexer for Azure File shares

                                      Index Azure File shares similar to blobs

                                      100 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                        4 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Add xpath syntax to promote out interesting values from source [XML] documents to predefined index fields

                                        I have lots of structured blobs (XML, JSON), I would like a mechanism to promote/extract a given field so it can be present in a specified index field rather than just rely on text in the content field? Or must I still run an external process to parse and write these promoted values instead of using built-in Azure Search features and the Data Source / Import process?

                                        13 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          under review  ·  2 comments  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Support for Postgresql for using indexers

                                          Please provide support for ingesting data from PostgreSQL, similar to the existing support for Azure SQL Database.

                                          8 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                            1 comment  ·  Crawlers  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1
                                          • Don't see your idea?

                                          Azure Search

                                          Feedback and Knowledge Base