It's partially the big hit to your income (each kid ~ -$200,000), and partially the fact that you're stuck driving either a minivan or an SUV. No Ferraris for most parents (minus the Mondial, but that barely counts).
However, my main reason for not wanting kids, and also the biggest hit to...