{"id":9561,"date":"2019-09-17T15:27:59","date_gmt":"2019-09-17T15:27:59","guid":{"rendered":"https:\/\/eurekainfomed.it\/?p=9561"},"modified":"2026-07-28T15:05:47","modified_gmt":"2026-07-28T15:05:47","slug":"reproducibility-of-systematic-reviews","status":"publish","type":"post","link":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/","title":{"rendered":"Reproducibility of systematic reviews: greater oversight for better publications?"},"content":{"rendered":"

Poor reproducibility of systematic review results is a common challenge in both primary and secondary research, often leading to reduced confidence in this type of study among the scientific community and the public.<\/p>\n

\n

To address this limitation, it has been proposed to introduce a final verification step<\/strong> within the systematic review process, with the aim of testing the reproducibility of results and increasing the overall robustness of the study<\/strong>. According to this proposal, systematic reviews should include the following stages: defining the research question; establishing eligibility criteria; searching for, collecting, and selecting data; assessing the methodological quality of studies and the statistical strength of the evidence; presenting and discussing the results; and, finally, testing their reproducibility.<\/p>\n

Reproducibility testing<\/h4>\n

Reproducibility testing can be conducted using two different approaches<\/strong>.<\/p>\n

A first option involves having a researcher from the same team<\/strong>, but not directly involved in the project, repeat the processes carried out by the original authors before the systematic review is finalized. This functions as a form of quality control. If discrepancies from the original findings<\/strong> are identified, the authors have an opportunity to review and revise the work before publication<\/strong>, clarifying and resolving the causes of the discrepancies.<\/p>\n

A second approach consists of having an independent group of authors review the results<\/strong> after the systematic review has been completed. At the conclusion of this process, both groups can discuss any discrepancies identified and amend the work accordingly. The cycle of review, discrepancy identification, and resolution may then be repeated for each stage of the study.<\/p>\n

Greater quality and transparency<\/h4>\n

The results of reproducibility testing should be documented in a report<\/strong> and published as a supplement to the systematic review<\/strong>, promoting complete and transparent communication and helping readers better understand the quality and reliability of the work.<\/p>\n

It is worth noting that systematic reviews are already evaluated through tools such as AMSTAR 2<\/strong> and ROBIS<\/strong>, which are designed to assess methodological quality and the risk of bias. However, these tools do not directly evaluate whether the results can be independently reproduced.<\/p>\n

Reproducibility testing could therefore become a new publication requirement<\/strong> for systematic reviews. The implementation of such a requirement could reduce the number of reviews with poorly reproducible or non-reproducible findings while encouraging the publication of higher-quality research.<\/p>\n

Source<\/p>\n

Faggion CM Jr. Should a systematic review be tested for reproducibility before its publication?<\/em> Journal of Clinical Epidemiology. 2019 Jun;110:96. doi:10.1016\/j.jclinepi.2019.02.008.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Poor reproducibility of systematic review results is a common challenge in both primary and secondary research, often leading to reduced confidence in this type of study among the scientific community…<\/p>\n","protected":false},"author":9,"featured_media":9571,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[26,27,4,1],"tags":[],"class_list":["post-9561","post","type-post","status-publish","format-standard","has-post-thumbnail","category-medical-information","category-medical-writing","category-news","category-uncategorized"],"yoast_head":"\nReproducibility of systematic reviews<\/title>\n<meta name=\"description\" content=\"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reproducibility of systematic reviews\" \/>\n<meta property=\"og:description\" content=\"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/\" \/>\n<meta property=\"og:site_name\" content=\"Eureka Info Med\" \/>\n<meta property=\"article:published_time\" content=\"2019-09-17T15:27:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-07-28T15:05:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"708\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"MariaAlbano\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"MariaAlbano\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/\"},\"author\":{\"name\":\"MariaAlbano\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/#\\\/schema\\\/person\\\/6d3d533571191bf3f16ec62a9057e4f8\"},\"headline\":\"Reproducibility of systematic reviews: greater oversight for better publications?\",\"datePublished\":\"2019-09-17T15:27:59+00:00\",\"dateModified\":\"2026-07-28T15:05:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/\"},\"wordCount\":407,\"image\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/09\\\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg\",\"articleSection\":[\"Medical Information\",\"Medical Writing\",\"News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/\",\"url\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/\",\"name\":\"Reproducibility of systematic reviews\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/09\\\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg\",\"datePublished\":\"2019-09-17T15:27:59+00:00\",\"dateModified\":\"2026-07-28T15:05:47+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/#\\\/schema\\\/person\\\/6d3d533571191bf3f16ec62a9057e4f8\"},\"description\":\"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#primaryimage\",\"url\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/09\\\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg\",\"contentUrl\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/09\\\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg\",\"width\":1000,\"height\":708},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/reproducibility-of-systematic-reviews\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reproducibility of systematic reviews: greater oversight for better publications?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/\",\"name\":\"Eureka Info Med\",\"description\":\"documentazione medico-scientifica e farmacovigilanza\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/#\\\/schema\\\/person\\\/6d3d533571191bf3f16ec62a9057e4f8\",\"name\":\"MariaAlbano\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g\",\"caption\":\"MariaAlbano\"},\"url\":\"https:\\\/\\\/eurekainfomed.it\\\/en\\\/author\\\/mariaalbano\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reproducibility of systematic reviews","description":"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/","og_locale":"en_US","og_type":"article","og_title":"Reproducibility of systematic reviews","og_description":"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.","og_url":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/","og_site_name":"Eureka Info Med","article_published_time":"2019-09-17T15:27:59+00:00","article_modified_time":"2026-07-28T15:05:47+00:00","og_image":[{"width":1000,"height":708,"url":"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg","type":"image\/jpeg"}],"author":"MariaAlbano","twitter_card":"summary_large_image","twitter_misc":{"Written by":"MariaAlbano","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#article","isPartOf":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/"},"author":{"name":"MariaAlbano","@id":"https:\/\/eurekainfomed.it\/en\/#\/schema\/person\/6d3d533571191bf3f16ec62a9057e4f8"},"headline":"Reproducibility of systematic reviews: greater oversight for better publications?","datePublished":"2019-09-17T15:27:59+00:00","dateModified":"2026-07-28T15:05:47+00:00","mainEntityOfPage":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/"},"wordCount":407,"image":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#primaryimage"},"thumbnailUrl":"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg","articleSection":["Medical Information","Medical Writing","News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/","url":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/","name":"Reproducibility of systematic reviews","isPartOf":{"@id":"https:\/\/eurekainfomed.it\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#primaryimage"},"image":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#primaryimage"},"thumbnailUrl":"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg","datePublished":"2019-09-17T15:27:59+00:00","dateModified":"2026-07-28T15:05:47+00:00","author":{"@id":"https:\/\/eurekainfomed.it\/en\/#\/schema\/person\/6d3d533571191bf3f16ec62a9057e4f8"},"description":"Introduce a final review step can improve reproducibility of systematic reviews and enhance their robustness.","breadcrumb":{"@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#primaryimage","url":"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg","contentUrl":"https:\/\/eurekainfomed.it\/en\/wp-content\/uploads\/2019\/09\/riproducibilit\u00e0-delle-revisioni-sistematiche.jpg","width":1000,"height":708},{"@type":"BreadcrumbList","@id":"https:\/\/eurekainfomed.it\/en\/reproducibility-of-systematic-reviews\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/eurekainfomed.it\/en\/"},{"@type":"ListItem","position":2,"name":"Reproducibility of systematic reviews: greater oversight for better publications?"}]},{"@type":"WebSite","@id":"https:\/\/eurekainfomed.it\/en\/#website","url":"https:\/\/eurekainfomed.it\/en\/","name":"Eureka Info Med","description":"documentazione medico-scientifica e farmacovigilanza","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/eurekainfomed.it\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/eurekainfomed.it\/en\/#\/schema\/person\/6d3d533571191bf3f16ec62a9057e4f8","name":"MariaAlbano","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3acb5c3722a1c5a1f5b23cf23db7a1e1f5cadd1ca3c60136f742e4aef6f7f7f3?s=96&d=mm&r=g","caption":"MariaAlbano"},"url":"https:\/\/eurekainfomed.it\/en\/author\/mariaalbano\/"}]}},"_links":{"self":[{"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/posts\/9561","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/comments?post=9561"}],"version-history":[{"count":6,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/posts\/9561\/revisions"}],"predecessor-version":[{"id":43523,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/posts\/9561\/revisions\/43523"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/media\/9571"}],"wp:attachment":[{"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/media?parent=9561"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/categories?post=9561"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eurekainfomed.it\/en\/wp-json\/wp\/v2\/tags?post=9561"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}