Well, if a new directory was created solely for Joomla, you should be able to just delete that folder.
Otherwise, if it was uploaded to the root web directory, you might have to download a copy of Joomla from http://joomla.com to see exactly which files were included in the install.