How can we improve Azure Automation service?

Export logs to Azure storage

We are using Azure Automation to orchestrate a number of operations including (1) moving some files around in BLOB storage (2) provisioning an HDInsight cluster and (3) kicking off a job on that cluster to process the data files.
The HDInsight job stores its logs in BLOB storage and our Operational Support have requested that we store all logs from our system in the same place.
The Azure Automation output logs are available through the Azure Portal or via Powershell, however that does not meet the requirement to store all logs from our system in the same place. We would love to be able to specify that the Azure Automation output logs automatically get stored in some given location in Azure BLOB Storage. This would enable to consume them however we like (our current preference is to expose them as a Hive table within our HDInsight cluster).

In summary this request is ... give us the option to store the Azur Automation output in BLOB Storage so that we can consume those logs however we wish.

68 votes
Vote
Sign in
(thinking…)
Sign in with: oidc
Signed in as (Sign out)
You have left! (?) (thinking…)
Jamie Thomson shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →
started  ·  Beth Cooper responded  · 

We are currently working on exporting Automation logs to Azure blob storage and to Log Analytics.

We are starting with job status and then adding in job streams. Please post back if there are specific pieces of information that you need to see included in these logs.

2 comments

Sign in
(thinking…)
Sign in with: oidc
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base