\ETA: I think any time to have children is probably the worst possible time, except for all the others.
That.
Also, my first was my hardest baby, followed by my third. My third was actually a harder baby, but I had the wisdom of experiencing the first and knowing for a fact that everything is a stage and everything passes, even the good stuff. Whoever said your next one would be easier because the first one was hard is an idiot. You get what you get. They might be easier, they might be harder... We were fooled by #2, who was easier, into thinking that we were better parents now. #3 came along to prove how wrong we were...