PDA

View Full Version : Is Peer-Review the Be All and End All of Science?


Petr
11-16-2006, 09:58 AM
http://www.evolutionnews.org/2006/11/is_peerreview_the_end_all_and.html


Is Peer-Review the Be All and End All of Science?


Science writer Denyse O'Leary has just published a four-part series about peer-review on her Post-Darwinist website. It is a thorough overview of what peer-review is and what some of the problems are with the current system. She has some interesting ideas on how this may be resolved in the future, but it is her identification of one major problem that is of most interest to the ID/evolution debate.

O'Leary notes that:

Generally, the two most common complaints are that peer review fails to safeguard quality, which was its original purpose and that it punishes new ideas, regardless of merit. ...

Findings that support a consensus are too easily accepted - that is the inevitable flip side to squelching new ideas.
Indeed, this is one of the problems that many design scientists have run up against in trying to get their papers published. Michael Behe has written about some of the problems he's faced in getting published in peer-review journals:

The take-home lesson I have learned is that, while some science journal editors are individually tolerant and will entertain thoughts of publishing challenges to current views, when a group (such as the editorial board) gets together, orthodoxy prevails.
Here are direct quotes from letters responding to submissions by Behe written by editors of major scientific journals:

I'm torn by your request to submit a (thoughtful) response to critics of your non-evolutionary theory for the origin of complexity. On the one hand I am painfully aware of the close-mindedness of the scientific community to non-orthodoxy, and I think it is counterproductive. But on the other hand we have fixed page limits for each month's issue, and there are many more good submissions than we can accept. So, your unorthodox theory would have to displace something that would be extending the current paradigm.
Another journal editor writes:

As you no doubt know, our journal has supported and demonstrated a strong evolutionary position from the very beginning, and believes that evolutionary explanations of all structures and phenomena of life are possible and inevitable. Hence a position such as yours, which opposes this view on other than scientific grounds, cannot be appropriate for our pages.
Of course Behe supports his work on completely scientific grounds, but the editorial board had already decided that someone whose views didn't completely match theirs would not be allowed to be heard. Behe defended his work as science in a letter responding to one journal that opted not to publish him:

The manuscript did not argue for intelligent design, nor did it say that complex systems would never be explained within Darwinian theory. Rather, it just made the simple, obvious, and unarguable point that gene duplication by itself is an incomplete explanation. Apparently, however, my skepticism about Darwinism overshadowed all other points. Everything I wrote beyond the first sentence was pretty much ignored or dismissed without engagement. I should also point out that, on the one hand, my paper discussed published experiments on specific genes in the clotting cascade of mice, the published misinterpretation of those experiments, and why that shows we need more information than sequence similarity to explain the origin of the cascade and other systems.
O'Leary hits the nail on the head in recognizing the main problem with the current peer-review system.

The overwhelming flaw in the traditional peer review system is that it listed so heavily toward consensus that it showed little tolerance for genuinely new findings and interpretations. The print and postage-based technologies of the mid-twentieth century greatly increased the significance of this flaw because only a few parties could afford to operate publishing systems. A small like-minded cabal can easily get control of such a system and run it into the ground, without significant challenge. By contrast, Internet-based technologies permit widespread low-cost access. The Internet may help to restore a more open and creative conversation - though it certainly won't sound pretty at first.
To sum up, science journals that are wedded to Darwinian evolution refuse to publish authors who explicitly advocate intelligent design. Then Darwinists attack intelligent design as unscientific because it isn't published in peer-reviewed journals. As Borat might say, "very nice."

For years the Darwinian lobbyists at the National Center for Science Education (NSCE) have falsely complained that scientists who support the theory of intelligent design don’t publish peer-reviewed articles, never mind that we have listed a number of pro-ID peer-reviewed papers on the Discovery Institute website. And there are hundreds of peer-reviewed articles that challenge one aspect or another of Darwinian evolution in the scientific literature.

http://www.discovery.org/scripts/viewDB/index.php?command=view&id=2640

When an article has appeared in a biology journal that the NCSE couldn't spin out of existence, they immediately clamored that the article shouldn’t have been published, despite the fact that it was approved by peer-review.

The article in question was, of course, "The Origin of Biological Information and the Higher Taxonomic Categories," written by CSC Director Dr. Stephen Meyer, and it appeared in the biology journal Proceedings of the Biological Society of Washington. The Proceedings is a peer-reviewed biology journal published at the National Museum of Natural History at the Smithsonian Institution in Washington D.C. Meyer’s article explicitly argued that the theory of intelligent design explains the origin of the genetic information in early animal forms better than current materialistic theories of evolution.

"It's too bad the Proceedings published it," lamented anthropologist Eugenie Scott, executive director of the NCSE. "... This article is substandard science."

In an interview with The Scientist, the editor of The Proceedings, Richard Sternberg, confirmed that Meyer’s article went through the standard peer-review process, and the three peer reviewers of the paper "all hold faculty positions in biological disciplines at prominent universities and research institutions, one at an Ivy League university, one at a major U.S. public university, and another at a major overseas research institute."

At the time, Meyer commented, “Darwinists have argued that intelligent design isn’t science because it hasn’t been published in peer-reviewed journals. But now that an increasing number of scientists are making their case for design in scientific publications, Darwinists are ready to disown peer-review—temporarily, I’m sure.”

As O'Leary's report on the state of peer-review asserts and the responses from journal editors make obvious, Darwinists seem to embrace peer-review only when it confirms their pre-determined conclusions. Their goal isn’t peer-review, it’s censorship. They want to squelch any dissent from the Darwinian paradigm.


Posted by Robert Crowther on November 15, 2006 2:52 PM |

Petr
11-16-2006, 10:01 AM
http://www.iscid.org/boards/ubb-get_topic-f-10-t-000059.html


Refereed Journals: Do They Insure Quality or Enforce Orthodoxy?

by Frank J. Tipler


Abstract- The notion that a scientific idea cannot be considered intellectually respectable until it has first appeared in a "peer" reviewed journal did not become widespread until after World War II. Copernicus's heliocentric system, Galileo's mechanics, Newton's grand synthesis -- these ideas never appeared first in journal articles. They appeared first in books, reviewed prior to publication only by their authors, or by their authors' friends. Even Darwin never submitted his idea of evolution driven by natural selection to a journal to be judged by "impartial" referees. Darwinism indeed first appeared in a journal, but one under the control of Darwin's friends. And Darwin's article was completely ignored. Instead, Darwin made his ideas known to his peers and to the world at large through a popular book: On the Origin of Species. I shall argue that prior to the Second World War the refereeing process, even where it existed, had very little effect on the publication of novel ideas, at least in the field of physics. But in the last several decades, many outstanding physicists have complained that their best ideas -- the very ideas that brought them fame -- were rejected by the refereed journals. Thus, prior to the Second World War, the refereeing process worked primarily to eliminate crackpot papers. Today, the refereeing process works primarily to enforce orthodoxy. I shall offer evidence that "peer" review is NOT peer review: the referee is quite often not as intellectually able as the author whose work he judges. We have pygmies standing in judgment on giants. I shall offer suggestions on ways to correct this problem, which, if continued, may seriously impede, if not stop, the advance of science.

To read the entire paper, click here.

http://www.iscid.org/papers/Tipler_PeerReview_070103.pdf

Insidium
11-16-2006, 04:53 PM
I don't think anyone will argue with you that science is conservative. Even the discovery of DNA as the genetic molecule was opposed because the accepted view at the time was that it was far too simple to cody for an entire organism. In fact, it took two experiments (both of which showed DNA was the genetic molecule) for the idea to be accepted. There are countless other examples. However, if a new idea is promising enough, it always gets through the filters. One must persevere. Complaining about scientific conservatism will get one nowhere.

Petr
11-17-2006, 04:46 PM
For years the Darwinian lobbyists at the National Center for Science Education (NSCE) have falsely complained that scientists who support the theory of intelligent design don’t publish peer-reviewed articles, never mind that we have listed a number of pro-ID peer-reviewed papers on the Discovery Institute website. And there are hundreds of peer-reviewed articles that challenge one aspect or another of Darwinian evolution in the scientific literature.
Some anecdotal evidence:

http://www.idthefuture.com/2006/11/budd.html#more


In That Stack of Papers, A Quiet Revolution

Paul Nelson

A friend who works at a national biomedical facility told me recently that he now finds it impossible to keep up with all the scientific literature challenging neo-Darwinism (i.e., textbook evolutionary theory). "The stuff just piles up in my office," he said. "I glance at the abstracts, download the pdfs, but can't read it all." We agreed that during 2005-2006, while the intelligent design controversy has been soaking up headlines and media scrutiny, leading evolutionary theoreticians themselves have been quietly uttering heresy in the halls of Darwin. It's easier to misbehave, you know, when someone else (ID) is really acting up and drawing off all the attention.

Here's an example, from the heap of hundreds (no kidding).

...

Insidium
11-17-2006, 06:17 PM
From the reference in your link:
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=pubmed&cmd=Retrieve&dopt=AbstractPlus&list_uids=16995957&query_hl=1&itool=pubmed_docsum

Although the mathematical principles underpinning population-level evolution are now well studied, the origin and evolution of morphological novelties has received far less attention. Here, a broad but general theory for how this sort of change takes place is outlined, relying on functional continuity, least-constrained components of morphology, redundancy and preadaptation. At least four distinct sorts of redundancy are identified: (i) redundancy arising through duplication (amplification); (ii) redundancy arising through regionalisation (parcellation); (iii) redundancy arising through functional convergence; and (iv) redundancy arising from shared function (functional degeneracy). Although organisms are here recognised to be functionally constrained ("burdened", in Riedl's terminology), these constraints can be overcome through the combination of the four principles given above. Contrary to its common treatment, functional constraint is neither an ever-increasing restriction on the scope of evolution, nor does it require drastic events to overcome or "break" it. Rather, it is an evolutionary quantity, subject to selection at some level. The rules that govern morphological evolution are the primary controls on what is allowed to happen in the evolution of the overall genotype-phenotype system, suggesting strong controls on the sorts of developmental changes that might be associated with macroevolution. This model, then, sees organism functionality as the primary control on evolvability, with exact genetic make-up being of secondary importance. It should prove possible to recast traditional notions of body-plan evolution into the formulations of complex system analysis, which in the future may prove a unifying discipline for fields as disparate as palaeontology and gene regulatory networks. In particular, understanding how morphology can evolve may provide the critical link between the ecological and morphological networks that are currently the intense focus of evolutionary investigations.

Seems to me like this so-called dissent from evolutionary theory is merely a further complexification of evolutionary thought, a new potentially viable method of understanding how evolution works. It certainly does not constrain or restrict evolution in any way. Like all good science, it merely (theoretically for now) increases our understanding of how something happened because it gives us a whole new angle from which to look at evolution. It's kind of unfortunate for you that ID cannot increase our scope of research in the least.

But I await for you to post links to some experiments that could only have made sense in the ID paradigm.

Petr
11-17-2006, 06:56 PM
Seems to me like this so-called dissent from evolutionary theory is merely a further complexification of evolutionary thought, a new potentially viable method of understanding how evolution works. It certainly does not constrain or restrict evolution in any way. Like all good science, it merely (theoretically for now) increases our understanding of how something happened because it gives us a whole new angle from which to look at evolution.
How's your reading comprehension? I got the idea that this would be an example of "the scientific literature challenging neo-Darwinism (i.e., textbook evolutionary theory." That is, stuff that does not cross the actual line into heresy but merely flirts with it at this point.

That is, not an example of "dissent from evolutionary theory." (Not of open dissent at least.)

You may argue that if one piles up enough micro-evolution, it will turn into macro-evolution. Well, I could argue that if one piles up enough "complexification of evolutionary thought", the picture will begin to get quite "complex" indeed.

Btw, can you give us your level of education, if we are going to take your word as evidence?


Petr

Insidium
11-17-2006, 07:03 PM
Anyone opposing "textbook" evolution (you know, simplified, ideal situations that are meant to convey the basic concepts of evolution) is committing a strawman fallacy. Textbooks are not designed to prove that evolution is a legitimate system. The student has no choice but to accept it as true based on the authority of the instructor since he has no qualification to critique what he is being taught.

Petr
11-17-2006, 07:04 PM
Do you refuse to give your age or level of education?


Petr

Insidium
11-17-2006, 07:10 PM
I am 20 and soon to be done with my BS in Biology.

Petr
02-20-2008, 06:42 AM
A little update:

http://voxday.blogspot.com/2008/02/case-against-peer-review.html


Tuesday, February 19, 2008

The case against peer review

Scientistry is demonstrably far more dangerous to science than religion:

The conventional narrative holds that, as the advantages of pooling knowledge became obvious, all scientists adopted the Royal Society's conventions: now, scientific papers are published freely. But that's not quite true. Actually, scientific journals are as closed as the Royal Society once was. The gatekeeper is "peer review": that is, papers are screened by experts, who judge if the experiments the manuscripts describe are credible.

But how, without having actually witnessed the experiments, can experts determine that? Reviewers have to trust the authors to have told the truth. Consequently, the most important part of a paper is the name at the top. If a well-known scientist submits a paper, it will probably be accepted; if an unknown submits one, it will probably be rejected. Science is still a closed club - partly to ensure that only accurate papers are published, but largely to prevent fraud.

But peer review carries dangers. First, it allows dunderheads to block unexpected ideas. Everybody within the scientific community knows of researchers such as Barbara McClintock, who won the Nobel Prize in 1983 for discovering gene jumping, a process by which scraps of DNA move about the genome. She was forced to publish her findings informally, in the annual reports of the Carnegie Institution, because she could not persuade peer reviewers to accept them.... Peer review was always an illusion, providing a deceptive imprimatur of objective truth.
http://www.telegraph.co.uk/earth/main.jhtml?xml=/earth/2008/02/19/scipeers119.xml

Peer review is a total joke. It's little more than the scientific version of union thuggery.


posted by Vox @ 2/19/2008 05:14:00 PM

Draco
02-21-2008, 11:28 PM
IMO, demonstrated and reproducible results should be the goal of proving a theory; peer review works well for things that are still mostly theoretical or too costly, dangerous, or impractical to demonstrate consistently.

Especially in cutting edge medicine and physics (and the like), it is understandable for peer review to serve as an acceptable "proving ground" for a theory.

IlluSionS667
02-22-2008, 02:35 PM
Refereed Journals: Do They Insure Quality or Enforce Orthodoxy?

by Frank J. Tipler


Abstract- The notion that a scientific idea cannot be considered intellectually respectable until it has first appeared in a "peer" reviewed journal did not become widespread until after World War II. Copernicus's heliocentric system, Galileo's mechanics, Newton's grand synthesis -- these ideas never appeared first in journal articles. They appeared first in books, reviewed prior to publication only by their authors, or by their authors' friends. Even Darwin never submitted his idea of evolution driven by natural selection to a journal to be judged by "impartial" referees. Darwinism indeed first appeared in a journal, but one under the control of Darwin's friends. And Darwin's article was completely ignored. Instead, Darwin made his ideas known to his peers and to the world at large through a popular book: On the Origin of Species. I shall argue that prior to the Second World War the refereeing process, even where it existed, had very little effect on the publication of novel ideas, at least in the field of physics. But in the last several decades, many outstanding physicists have complained that their best ideas -- the very ideas that brought them fame -- were rejected by the refereed journals. Thus, prior to the Second World War, the refereeing process worked primarily to eliminate crackpot papers. Today, the refereeing process works primarily to enforce orthodoxy. I shall offer evidence that "peer" review is NOT peer review: the referee is quite often not as intellectually able as the author whose work he judges. We have pygmies standing in judgment on giants. I shall offer suggestions on ways to correct this problem, which, if continued, may seriously impede, if not stop, the advance of science.

I actually agree on this issue, however I disagree with your views on evolution.

IMO, demonstrated and reproducible results should be the goal of proving a theory; peer review works well for things that are still mostly theoretical or too costly, dangerous, or impractical to demonstrate consistently.

Especially in cutting edge medicine and physics (and the like), it is understandable for peer review to serve as an acceptable "proving ground" for a theory.

The problem is that it can be abused and is continuously abused to uphold the mainstream consensus and silence dissident views.

ironweed
02-22-2008, 05:02 PM
Do you refuse to give your age or level of education?


Petr


Do you? -filler-