Yeah... I think his point on scientific integrity may be most spot on - that you need to list all other explanations you can honestly think of (rather than just come up with a few explanations that you your findings would contradict). Take for example those priming studies which fail to replicate.[url=http://meincmagazine.com/civis/viewtopic.php?p=29657173#p29657173:1x78s096 said:Kalessin[/url]":1x78s096]Are the two of you familiar with Feynman's "Cargo Cult Science" commencement address at Caltech and the subsequent adapted essay?[url=http://meincmagazine.com/civis/viewtopic.php?p=29654061#p29654061:1x78s096 said:Dmytry[/url]":1x78s096]And yet there's always replication studies in physics as it is a quantitative field where new experiments improve accuracy or are necessary for practical applications.[url=http://meincmagazine.com/civis/viewtopic.php?p=29650447#p29650447:1x78s096 said:bluloo[/url]":1x78s096]
As you note, there's a greater certainty in the observations found in physics experiments, so replication studies aren't often necessary.
The excuse from folks doing those priming studies - there's so many factors, maybe something is missing in a replication.
Well that's the whole point - in the original findings, there was even more unknown factors involved (with a stopwatch and everything, whereas a replication uses IR sensors), you don't know that it is the priming idea which is the cause (even if we take it on face value that there was a difference between the groups in the first place). If it fails to replicate, and a replication tried to recreate priming (but not the unknowns), then the cause is somewhere within unknowns.
If a chemist uses dirty glassware and finds that, surprisingly, X catalyses a reaction a little bit (he was testing X's efficacy as catalyst), and others fail to replicate, well it's his fault he didn't write in his paper that the bottles were so and so dirty and the catalyst could be any one of the compounds in "dirty" (and to actually make a contribution he'd have to painstakingly find which compound it was). There was the "form hypothesis" and "test hypothesis" but "actually figure out something" was absent. (That sometimes happens in physics too, and guess what, physics can't get away with it and neither can any other field.)
edit: cite on the priming story.
Now what I think is true, though, is that the priming findings are probably no worse than most other findings - just under greater scrutiny (the physics equivalent would be, I dunno a special paint that makes airplanes go faster - of course that's gonna be replicated because it is practically useful - it is often useful to get people to walk faster or score better on memory tasks).