Interesting thought, but that means if I go on vacation or move out-of-state (or out-of-country) I can't access my site because my IP Address will definitely change, locking me out.
The username/password is the lynch-pin to protection, not the IP address.