If you start connecting to a server and stop midway (e.g. waiting for PIN entry), eventually the SSH server will time out and kill the connection. This isn't apparent on the client end until you've dismissed the dialog. If possible, we should notice ssh disconnecting and close the dialog automatically.