Cloud Device Administrator is the new role that will provide this capability . This will be generally available in the coming monthsSagar commented
The user role User administrator is not able to remove users registered device objects in Azure AD. I think that roles should be granted that permission.
Or create an additional role that have the permission to remove device objects in Azure AD.