10K record limit in Analytics.
I am collecting Analytics data by using Continuous Export. The problem I am running into is the 10K record limit in Analytics to run queries against. I need to be able to query at least a months worth at a time.
Do you have tools other than Analytics to work with larger files? Is there a tool that can parse the log files better?
Could we get some more information about what exactly the request is here?
The 10,000 row limit only applies to the amount of data returned by a query – the query still runs over the entire dataset within App Insights. There’s usually some data aggregation that you are looking for, not the raw data itself, and for that you can be using operators. If it’s looking through distinct values or counts thereof, there’s the summarize operator; if it’s filtering down to a particular value of a particular field – there’s “where”; etc. Do note that all these aggregations, filters, etc work across as big a dataset as you throw at them: it is only the final result set where you’re limited to the 10k rows.
If this doesn’t help with your query let us know more specifics as to what you are trying to achieve.
Jim Balazic commented
Thank you for the explanation on the 10k limit. So what you are stating is that the limitation is in the return of records from a query and not that I uploaded 400k worth of data.