If you left your e-mail public somewhere or you sent the spammer a message via your site, the person probably went through the trouble and connected the dots to spam you from what appeared to be your server. The e-mail headers though do show it all though.
But finding out what server you're on...