It's basically a 16x16 .ico file that sits in your site's main directory. To create the file you can either use photoshop or there are several online Favicon convertors such as this:
Save the file as 'favicon.ico'. Then simply upload the file to your site's main directory and insert the following code into the head tag of every page you want the favicon to appear on.