high resource usage is almost never related to the number of visitors (unless you got a few thousand), most of the time it is poorly coded plugins causing them.
some cache plugins are known to cause a problem, as they tend to use up a bit extra resources at the moment of adding the content to...