Fix segfault when you press a key before the SSH protocol decides whether