When I go to the admin URL shown on my installation details screen I get a 404 not found (the page that starts out: WHOOPS, OUR BAD...
The page you requested was not found
I found the problem. It needed to have index.php/admin123 at the end instead of just /admin123. However, the installation details screen shows it without index.php, which of course causes confusion.