Really, every script you run other than html or php would increase server load, so yes, javascript could make a difference. But, like you say, its quite a lightweight site. You could try disabling some Joomla components and see what happens when nobody can use them. I have a site that looks like...