Supervised user whitelists: Cleanup