Be Skeptical of “Case-Control” Studies— About 70% are Mislabeled

Genuine case-control studies must adhere to specific timing requirements (ensuring that exposure precedes outcomes) and defined outcome-based grouping criteria. In practice, however, the term “case-control study” is frequently misapplied. Such mislabeling, critics say, erodes core principles of epidemiology research and perpetuates conceptual misunderstandings regarding cause and effect as well as appropriate study design selection. “Collectively, these effects compromise the translational fidelity of research evidence into clinical practice and undermine the methodological foundations of evidence-based medicine,” wrote a group of researchers from China in a new paper for Translational Vision Science & Technology. This infographic from the study shows the geographic distribution of mislabeled studies. Those published in North America fared best in this analysis but still failed to meet appropriate criteria two-thirds of the time. Photo: Zeng T, et al. Transl Vis Sci Technol. 2026;15(4):11. Click image to enlarge.The team recently conducted a bibliometric analysis to characterize the prevalence and determinants of case-control study mislabeling in 95 ophthalmologic journals. Rigorous methodological evaluation of 386 English-language articles published from 2022 to 2023 confirmed that only 29.3% satisfied predefined case-control criteria. The vast majority—273 studies (70.7%)—were mislabeled. Systematic analysis demonstrated that 49% of mislabeled studies exhibited “upward distortions of evidence levels,” the researchers wrote. This was predominantly driven by the erroneous categorization of 190 cross-sectional studies as case-control studies. Conversely, 18% were subject to downgrading. Top-Tier Ophthalmology Journals by JCR Rankings Studies published in these journals had significantly lower odds of being mislabeled. (Rankings calculated from data tracked by Journal Citation Reports based on “impact factor.”)• Ophthalmology• JAMA Ophthalmology• American Journal of Ophthalmology• British Journal of Ophthalmology• Progress in Retinal and Eye Research• Survey of Ophthalmology• Ocular Surface• Annual Review of Vision Science• Ophthalmology Retina “This comprehensive analysis reveals a profound and systemic issue of methodological misclassification in recent ophthalmologic literature,” the study authors wrote in their paper. “More than two-thirds of self-declared case-control or case-controlled studies were mislabeled, which directly distorted the assigned levels of evidence in most cases.”Logistic regression revealed that articles published in top-tier journals (see box) had significantly lower odds of being mislabeled (odds ratio: 0.511) compared with the lowest-ranked journals. No significant association was found between mislabeling and the place of publication in the world.Reclassification of the mislabeled revealed that cross-sectional studies predominated (n=190), followed by retrospective cohort studies (n=37), prospective cohort studies (n=22), diagnostic tests (n=14), randomized controlled trials (RCTs; n=3), before-and-after studies (n=2) and non-RCTs (n=1). Additionally, four composite studies lacked case-control components, consisting of combinations of cross-sectional and retrospective cohort studies (n = 2), cross-sectional and diagnostic tests (n = 1) and cross-sectional and prospective cohort studies (n = 1). Among the validated case-control studies, 39 used variant designs, including nested (n=7), matched (n=8) and genetic association studies (n=24), alongside 17 composite studies that incorporated case-control components. These composite studies comprised combinations of case-control with retrospective cohort studies (n=9), case-control with cross-sectional studies (n=7) and case-control with prospective cohort studies (n=1). According to the researchers, their finding that top-tier journals exhibited a lower prevalence of mislabeling underscores the potential of rigorous methodological scrutiny to uphold study design standards. They advocate for “systematically integrating robust methodological appraisal into the editorial and review processes across all journal tiers,” they wrote.“For sustained improvement, a dual long-term approach is recommended, combining technological support, such as artificial intelligence for initial screening, with strengthened foundational training in epidemiological concepts for researchers and clinicians,” they proposed. “Ensuring the fidelity of clinical evidence will require strengthened reporting standards, technological support and a renewed commitment to epidemiological education.” When compared with other specialties, this study’s rating of ophthalmology research aligns with those in orthopedics (67%) and neurosurgery (63%) but is notably higher than the rate in obstetrics/gynecology (30%).“These variations underscore that differences in journal inclusion criteria, time frames and search methodologies significantly influence reported mislabeling rates across disciplines,” the researchers noted.Click here for the journal source. Zeng T, Yu Z, Guo J, et al. Mislabeling of case-control studies in ophthalmologic literature: a bibliometric analysis. Transl Vis Sci Technol. 2026;15(4):11.   This article was developed by the editorial staff in conjunction with experts in the field. In the process, AI may have been among the editorial tools used to meet the goals of human editors, who approved all content.