Error message of delete failure should be more specific.
Even just the App Insights resource is locked to prevent to be deleted, we can't determine it since the error message is as below.
"Could not deleted
Could not delete application"
The message should be more specific like as other resources such as Web Apps.
We’re slotting this into our backlog.