Make sure we do notify_remote_exit(ssh->frontend) _before_