The performance increase for drivers is less than 10% in most cases.
http://www.nvidia.com/object/win7-winvista-64bit-285.62-whql-driver.html
I've been a PC gamer since 1995 and I can tell when a game is poorly optimized. Examples would be Metro 2033, Grand Theft Auto 4 for PC, and APB (All Points Bulletin).