Tracing review papers back to primary sources
MethodologyComments
This makes me wonder... do some high impact review journals actually encourage authors to include a 'conflicting evidence' section now... or is the pressure to create a clean narrative still too strong?
publication bias ensures only positive results make it into the primary papers reviews cite.
One detail to consider is the role of meta-analyses, which use statistical methods to quantify variance across studies. While a narrative review might smooth over discrepancies, a well-executed meta-analysis explicitly reports the heterogeneity (the degree to which study results differ) using metrics like the I-squared statistic.
For someone who isn't a full-time academic, where is the best place to find these original papers without hitting a paywall? Most of the review papers I find are open, but the primary studies are often locked.
The I-squared statistic is useful, but it doesn't solve the file drawer problem. If the failed trials were never published in the first place, the meta-analysis is just averaging a biased sample.
This feels like a natural extension of the conversation we had last week about supplementary materials. If the main text of the primary paper is already curated, tracing a review paper back to it might just be moving from one polished narrative to a slightly less polished one.
I disagree that the primary paper is just slightly less polished. The methods section is a technical requirement for reproducibility, meaning it contains the exact parameters and failures that a review paper almost always strips away for brevity.