Variable data retention (longer or shorter than the 90-day default)

Please provide longer retention for raw data. I'm willing to pay for (the additional azure storage)!

165 votes

(thinking…)

Microsoft

Forgot password?

Create a password

Signed in as (Sign out)

We’ll send you updates on this idea

Anonymous shared this idea · December 16, 2016 · Flag idea as inappropriate… · Admin →

completed ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · October 07, 2019

Great news! Application Insights variable retention is now completed.

You can set your retention both in the Azure Portal and via ARM. Learn more at https://docs.microsoft.com/en-us/azure/azure-monitor/app/pricing#change-the-data-retention-period.

Please let me know if you have any questions.

Thank you
Dale Koetke

Show previous admin responses (13)

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · October 04, 2019

The Application Insights retention UI is returning in a few days… all the fixes are in and it’s just a matter of deployment.

If you need to change you retention before the UI is back, you can now change retention using ARM: see https://docs.microsoft.com/en-us/azure/azure-monitor/app/pricing#change-the-data-retention-period.

Thanks for your patience!

Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · August 28, 2019

We’ve temporarily removed the Data retention UI while we fix a potential issue. I hope to have this re-enabled by the first week of October and will update the status here. Apologies for any inconvenience. Retention changes made previously are still in effect.

Billing for additional retention is expected to start late in 2019.

Please let me know if you have any questions.

Dale Koetke
dalek@microsoft.com

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · August 19, 2019

Users can now configure the data retention on their Application Insights resources! To change the retention, from your Application Insights resource, go to the “Usage and Estimated Costs” page and select the “Data Retention” option.

Billing for additional retention is expected to start in November.

Please let me know if you have any questions.

Dale Koetke
dalek@microsoft.com

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · June 13, 2019

We are still taking requests for onboarding to the preview of Application Insights variable retention. Some features required to enable this via self-service are taking longer than expected, but we are still working it, and in the meantime will be glad to enable your Application Insights resource to have different retention settings.

The first iteration of this feature will allow setting retention up to 2 years in several increments for each Application Insights resource (e.g. not by data type). The pricing for this will follow the same Azure Monitor log data retention pricing as used by Log Analytics.

We will be able to onboard a limited number of customers manually in the coming weeks. If you’re interested, please send me (dalek@microsoft.com) the instrumentation key(s) of your Application Insights resource(s), and the desired retention duration (30, 60, 120, 180, 270, 365, 550 or 730 days).

Thank you
Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · February 12, 2019

Application Insights variable retention is in active development now with release planned the first half of 2019.

We will be able to onboard a limited number of customers manually in the coming weeks. If you’re interested, please send me (dalek@microsoft.com) the instrumentation key(s) of your Application Insights resource(s), and the desired retention duration (30, 60, 120, 180, 270, 365, 550 or 730 days).

Thank you
Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · December 26, 2018

Application Insights variable retention is in active development now with release planned the first half of 2019.
Thank you
Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · November 22, 2018

This work is planned for early 2019. This work is in the queue behind a few other high priority items.
Thank you
Dale Koetke

started ·

AdminDale Koetke (Admin, Microsoft Azure) responded · October 09, 2018

This work is still planned for late 2018. It’s in the queue behind some other work we need to complete first.
Thank you
Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · May 14, 2018

This is still in progress with the intent to deliver the end-to-end solution late in the second half of 2018.
Thank you
Dale Koetke

started ·

AdminApplication Insights Team (Product Manager, Microsoft Azure) responded · March 12, 2018

The back-end work required for this is in progress now, and we’ll start of the user experience later this spring.
Thank you
Dale Koetke

under review ·

AdminDale Koetke (Admin, Microsoft Azure) responded · September 25, 2017

This is still on the team’s backlog, but there are other higher priority items such as cross-resource queries and enabling Log Analytics to run on the same Analytics backend and query-language that have needed resources first.

Thank you for your patience! We do understand how important this is for our customers!

Dale

under review ·

AdminDale Koetke (Admin, Microsoft Azure) responded · June 21, 2017

This is still on the team’s backlog, but there are other higher priority items such as cross-resource queries that are in the queue ahead of this.

Additional feedback about what specifically you’d like in terms of retention would be appreciated.

Thank you
Dale

under review ·

AdminDale Koetke (Admin, Microsoft Azure) responded · March 31, 2017

We intend to add longer data retention to Application Insights, but this is behind other work in the team’s backlog, such as cross-resource queries.

Additional feedback about what specifically you’d like in terms of retention would be appreciated.

Thank you
Dale

28 comments

Add a comment…

Attach a File

(thinking…)

Microsoft

Forgot password?

Create a password

Signed in as (Sign out)

Submitting...

An error occurred while saving the comment

Anonymous commented · September 27, 2019 15:55 · Flag as inappropriate

Love to have variable retention for AI

Submitting...
Anonymous commented · September 03, 2019 23:43 · Flag as inappropriate

Can this be done via powershell script, while UI is not Up ?

Submitting...
Adam Bartha commented · August 28, 2019 02:21 · Flag as inappropriate

Any idea why the "Data Retention" option is not shown on a newly created AppInsights instance?

https://docs.microsoft.com/en-us/azure/azure-monitor/app/pricing#change-the-data-retention-period

Submitting...
Thijs Brobbel commented · August 20, 2019 00:03 · Flag as inappropriate

Awesome!!

Submitting...
Rasmus W. commented · August 19, 2019 11:44 · Flag as inappropriate

Great to have this enabled after all this time. The "Export as Template" functionality in the Portal doesn't show the property name and value.

Luckily, the Resource Explorer does show it. It is called Retention, and the value is a time interval in days, like this:
"Retention": "P730D"

Submitting...
takekazu.omi commented · August 19, 2019 09:39 · Flag as inappropriate

Hi, Dale,

We used the Application Insights Connector and Log Analytics to set retention of 360 days and save the logs.
However, the transfer to Log Analytics with Application Insights Connector has stopped at 6/30.

This feature makes it possible to extend the retention on the Application Insights side, so the Insights Connector is no longer needed. Great. Thank you.

However, in this case, logs will be lost unless the retention of Log Analytics is extended to the end of September. You should warn users of this problem.

Submitting...
Anonymous commented · July 22, 2019 08:16 · Flag as inappropriate

needed

Submitting...
Gabriel Schechter commented · July 15, 2019 13:43 · Flag as inappropriate

Any estimation when this will be GA?

Submitting...
takekazu.omi commented · July 01, 2019 22:35 · Flag as inappropriate

The Application Insights retention period should also be the same as Log Analytics. I was forwarding to Log Analytics with Application Insights Connector management solution when storage for more than 90 days was required.
https://docs.microsoft.com/ja-jp/azure/azure-monitor/platform/app-insights-connector
However, the Application Insights Connector was retired in 6/30.
It is inconvenient that the Connector management solution is discontinued prior to this ticket.

Submitting...
Aidan Bree commented · June 27, 2019 02:16 · Flag as inappropriate

Has this really been in preview for 3 years without general release??

Submitting...
Clarence commented · May 16, 2019 19:57 · Flag as inappropriate

Hi, may I know when this feature going to be GA? Otherwise, how can I turn this feature on?

Submitting...
Ádám Bartha commented · May 13, 2019 06:15 · Flag as inappropriate

Any estimation when this will be GA?

Submitting...
Anonymous commented · May 10, 2019 08:27 · Flag as inappropriate

any updates on this?

Submitting...
Mihael commented · April 09, 2019 03:46 · Flag as inappropriate

Hello App Insights team,

A fine-grained policy would be very welcome. E.g. some data would be stored for 7 days only, others for 2 month.

Submitting...
Sabanayagam Jayabalan commented · April 04, 2019 09:12 · Flag as inappropriate

what if we have missed to export application insights data and 90 days has elapsed? What is the process to fetch the data prior to 90 days?

Submitting...
Clarence commented · February 27, 2019 19:22 · Flag as inappropriate

Hi App Insights product team,

This feature is definitely needed. May I know if there are plans to extend it for periods longer than 2 years?

Submitting...
Robert commented · February 04, 2019 01:39 · Flag as inappropriate

Dear App Insights Team,

is there any update on this so far? Maybe a more precise release date?
Some business decisions are depending on this feature and when it´s eventually gonna be released.

BR Robert

Submitting...
Ketan commented · November 01, 2018 12:44 · Flag as inappropriate

We need for minimum 2 years

Submitting...
Anonymous commented · October 09, 2018 06:44 · Flag as inappropriate

How fine grain could that data retention be specified? Could we have some data stored for 2 days (e.g. snapshots) and the rest for 30 days?

Submitting...
Anonymous commented · October 08, 2018 07:04 · Flag as inappropriate

Hi is there any update on this feature?

Submitting...