Deleting Application Insights Resource does not remove site extension from app service using that resource
When removing Application Insights from an app service, you can delete the resource in the portal. But it still keeps the site extension for the Application Insights Profiler web job installed and running. You have to manually uninstall the site extension to fully remove all traces of application insights from the app service. This should happen automatically.