On Unix, we currently set the default path of the private key to $HOME/.ssh/id_rsa. On Windows, it is left empty. We should consider if there is some relevant default path on Windows as well and add the code to set it.
See also bug 3555.