Avoid freeing the backend in notify_remote_exit(), since that's