Support for crawling HTML/websites
Enable Azure Search to crawl a local HTML website
Thank you for your feedback. While it is unlikely we’ll address this suggestion in the next 6 months, we’ll reassess based on the number of votes it receives in the next 6 month cycle.
Azure Search Product Team
Hi Azure Search Team,
It will be enterprise search replacement if you provide crawling of HTML/Web Sites. Competitor has the functionality. Please provide this.
Hi Team it will be good if we can have some feature to index pdf from the webpage as currently we have blob storage to index from file system
I have searched but didnot found anything for website crawling so can we
use norconex for crawling in azure is it microsoft supported crawler?
How we can crawl any other website into the azure search
although this is a workaround, hopefully this will be a default feature of Azure Search.
ps. maybe Azure Search can't directly index website url since it might involve web security issue.
Azure Search now supports crawling Azure blob storage and indexing HTML documents. While it's not quite the same as crawling a website, this may be of significant help. Please see https://azure.microsoft.com/en-us/documentation/articles/search-howto-indexing-azure-blob-storage/ for more details.
Azure Search team