if you are new to linux, ubuntu is great as its package lists have 30,000+ packages. Other Distros often require you to compile less common libraries, which can get more involved.
For stability, CentOS is usually the better choice(my ubuntu vps hasn't had any downtime though, i would prefer...