You pay a congestion price anyway: the difference is whether you pay it in time or $. Paying with wasted waiting time is always societally suboptimal.