Make raw logs available for CDN traffic
If raw logs were made available and posted to blob storage, developers could use them for sub-billing our customers for their usage of the CDN.
I would require this functionality for advanced logging reports such as knowing a combination of country, device and browser version per request
Masami Suzuki commented
any updates ?
Riccardo Fuzzi commented
Maybe you can achieve this using the Application Gateway and exporting Diagotistics.
any upadte on this?
This could be blocker for me to move to Azure from another CDN which provides the logs, and I use this for sub-billing of my customers (based on api_key parameter in URLs). I send the logs to S3 bucket and consume them easily using SQL via AWS Athena. Having ~100M requests per day is nothing difficult there.
Sub-billing would also be possible if Azure CDN supported wildcard custom domains. Under "Manage" -> "Analytics" -> "Custom reports" -> "Edge CNAMEs" you can already see statistics about traffic from different custom domains. Combined with wildcard custom domains and SSL on them, this would be an awesome feature.
Complexity of analyzing raw logs is no reason for not having this feature.
"but processing this kind of data is expensive and many times you don't need it." > is completely wrong assumption.
Many does analyze this kind of data.
Radu Vunvulea commented
This feature is interesting, but I'm trying to imagine how easy is to process this raw data once you have it. Also the size of them can be incredible big. Imagine that you're cache is hitted with a raite of 100.000 RPS.
The same things is with Azure Blob Storage, we have this feature, is very powerful, but processing this kind of data is expensive and many times you don't need it.
We need the log data to see which assets are most popular.
How can we access the raw CDN logs?
Ching Yi Chan commented
We need the raw log to generate the user report for the performance assessment.
Brenden Grace commented
+1 ... Azure really needs a feature like this if they want to compete against other CDNs (especially in the advertising space).