Why are so many leading modern scientists intellectually dull
and lacking in scientific ambition? The short answer is: because
the science selection process ruthlessly weeds-out interesting
and imaginative people.
I'm going to add an enthusiastic HE'S RIGHT! to this debate. I'm a scientist and am constantly confronted with the way the system works.
Universities aren't what they were even 20 years ago (much less 30, 40, or 50+ years ago). Nowadays, they're completely organized around grants. Principal investigators (eg entry level faculty and up, plus non-tenure track independent researchers) are responsible for obtaining their own salary money, in addition to money to pay technicians, postdocs, etc, and money for supplies. People who don't get grants pretty much don't get tenure. Which means they get fired.
NIH in particular simply will not fund a grant application deemed to be too risky, and "risky" has a broader definition than you'd expect. The standard conventional wisdom among applicants is that you have to have done the work already before they'll fund it. This sounds ridiculous, but it's generally true. Even SBIR grants to small businesses, which are defined as being risky, don't get funded unless the risk is extremely minimal.
The problem is compounded by an application rejection rate of 80 - 90% (80% now with the stimulus money, like back to 90% sometime soon). This means that only the applications with the highest likelihood of succeeding (meaning, the most incremental work) will get funded. The people who get funded are getting older too: the average age to get your first R01 (what you could call your basic meat-and-potatoes NIH grant) is over 40 now.
In the early 1970s, success rates with applications at NIH were somewhere around 1/3 and the average age of getting your first R01 was around ten years younger (maybe more).
I've heard that the mainstream science directorates (as opposed to science education departments) at the NSF are much the same.
Lee Smolin has a detailed analysis of the whole mess in the last few chapters of his book "The Trouble with Physics." These chapters are separate from the topic in the rest of the book and I recommend them to anyone interested in reading more.
This is a huge mess and if it isn't fixed, the US will lose its position as a leader in scientific research!
Val