Ok, I'm an idiot. I setup to hide both wp-admin and login page. I made a note of the recovery page, and went about my business.
Then the new login page failed to load, ignoring my request (I have "hide 404 errors" turned on with iThemes security). So I went to the rescue link. All worked fine...