Open-access The Immense Challenge of Searching for the Best Evidence

Keywords Arrhytmias, Cardiac; Coronavirus, Infections; COVID-19; Anticoagulants; Atrial Fibrillation

To generate the best scientific evidence, it is crucial to follow rigorous research methods, use representative samples, apply appropriate statistical analyses, and ensure peer review in reputable scientific publications. Transparency and replicability are also key.1 Systematic reviews and meta-analyses aim to summarize a body of available evidence for a given question and provide a high-quality answer.2

New situations add variables not previously analyzed, and the COVID-19 pandemic has raised big questions. The urgency to find effective treatments and develop vaccines has encouraged a global mobilization of the scientific community. Contributing factors were: the global health emergency, international mobilization, priority funding sources, greater availability of data networks, and high technology, which stimulated a real race in search of answers. This convergence of factors resulted in an explosion of publications, seeking to better understand the pathophysiology, treatment options, prevention measures, and socioeconomic impacts. As would be expected, in the rush, most of the publications were of poor quality, some of which generated misinformation with serious consequences, as many of these had great repercussions in the media.3 During the course of the pandemic, numerous guidelines were generated and changed.4 There were notable discrepancies between different guidelines regarding recommendations on the management of COVID-19 in Brazil.5

The regular use of oral anticoagulants (OAC) in patients with atrial fibrillation (AF), depending on their risk profile, has proven to have an impact on reducing thromboembolic stroke and mortality, being an indication enshrined in guidelines with a high degree of evidence.6

The article by Landsteiner et al.,7 in this issue of the ABC Cardiol, seeks to answer what is the best approach for a patient with AF, who regularly uses OCP, and who is affected by COVID-19. The authors produce a careful meta-analysis aiming to find the answer regarding the risk versus benefit of using OAC in this clinical context.

Quality meta-analyses, which can include prospective randomized studies, constitute the gold standard for the best evidence. However, one must take into account the major challenges to be overcome to produce a quality meta-analysis with the selection of studies to be included, identify potential biases, heterogeneity, quality of studies, incomplete data, reporting bias (publications only with favorable data), and the ability to generalize.8

The authors7 systematically searched PubMed, Embase, and Cochrane Library for eligible studies from the start of the pandemic until December 2022, including those that compared COVID-19 outcomes in patients with and without prior chronic oral anticoagulation for AF. The selection work used a rigorous protocol seeking publications with higher quality and less chance of bias, which is essential in the case of observational studies. The description of the "Statistical Analysis" present in the article7 gives the notion of how complex the process is, with numerous tools being used to seek to reduce potential limitations and thus, the best evidence. Initially, 596 studies were selected, with 493 excluded, 26 reviewed, and only 10 considered for analysis. Despite the robust number of cases included, heterogeneity was always an element to consider.

To assess the risk of bias in the selected material, the authors used the ROBINS-I (Risk of Bias in Non-randomized Studies of Interventions) tool. Its limitations include dependence on the quality of reports, challenges in categorizing bias, and the need for subjective judgment on the part of evaluators. Additionally, ROBINS-I may not fully address all sources of potential bias in certain contexts. This is one of the aspects highlighted in the article itself in the limitations of the study.9,10

With all this, the authors in the discussion recognize that there is no complete certainty of the results, mainly due to the lack of knowledge of the conditions and what were the impediments to hospital treatment, which only adds value to the work now published.

The conclusion is in line with the strongest scientific plausibility: anticoagulation reduces the risk in patients with atrial fibrillation.

As always, the best decision will be made on a case-by-case basis, where risks versus benefits will be assessed and shared with the patient, according to the available evidence.

  • Short Editorial related to the article: Chronic Anticoagulation in Patients with Atrial Fibrillation and COVID-19: A Systematic Review and Meta-Analysis

References

  • 1 Khanna R, Aparasu RR. Research Design and Methods. In: Aparasu RR, Bentley JP. eds. Principles of Research Design and Drug Literature Evaluation, 2nd. Philadelphia: McGraw-Hill Education; 2020. ISBN:978-1-260-4478-9
  • 2 Labarca G, Letelier LM. Is the Systematic Review and Meta-Analysis the Gold Standard for Scientific Evidence? Arch Bronconeumol. 2022;58(10):679-80. doi:10.1016/j.arbres.2021.08.007
    » https://doi.org/10.1016/j.arbres.2021.08.007
  • 3 Raynaud M, Zhang H, Louis K, Goutaudier V, Wang J, Dubourg Q, et al. COVID-19-related medical research: a meta-research and critical appraisal. BMC Med Res Methodol. 2021;21(1):1. doi: 10.1186/s12874-020-01190-w
    » https://doi.org/10.1186/s12874-020-01190-w
  • 4 Xie J, Wang Z, Liang J, Lin H, Yang Z, Wang Y, et al. Critical Review of the Scientific Evidence and Recommendations in COVID-19 Management Guidelines. Open Forum Infect Dis. 2021;8(8):ofab376. doi: 10.1093/ofid/ofab376
    » https://doi.org/10.1093/ofid/ofab376
  • 5 De Moraes, Rodrigo Francalossi (2022): Ciência e pseudociência durante a pandemia de Covid-19: O papel dos "intermediários do conhecimento" nas políticas dos governos estaduais no Brasil, Texto para Discussão, No. 2743, Instituto de Pesquisa Econômica Aplicada (IPEA), Brasília, https://doi.org/10.38116/td2743
    » https://doi.org/10.38116/td2743
  • 6 Writing Committee Members, Joglar JA, Chung MK, Armbruster AL, Benjamin EJ, Chyou JY, et al. 2023 ACC/AHA/ACCP/HRS Guideline for the Diagnosis and Management of Atrial Fibrillation: A Report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. J Am Coll Cardiol. 2024;83(1):109-279. doi:10.1016/j.jacc.2023.08.017
    » https://doi.org/10.1016/j.jacc.2023.08.017
  • 7 Landsteiner I, Pinheiro JA, Felix N, Gewehr DM, Cardoso R. Anticoagulação Crônica em Pacientes com Fibrilação Atrial e COVID-19: Uma Revisão Sistemática e Metanálise. Arq Bras Cardiol. 2024; 121(3):e20230470. DOI: https://doi.org/10.36660/abc.20230470
    » https://doi.org/10.36660/abc.20230470
  • 8 DerSimonian R, Laird N. Meta-analysis in clinical trials revisited. Contemp Clin Trials. 2015;45(Pt A):139-45. doi: 10.1016/j.cct.2015.09.002.
    » https://doi.org/10.1016/j.cct.2015.09.002
  • 9 Sterne JA, Hernán MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, et al. (2016). ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. doi: 10.1136/bmj.i4919.
    » https://doi.org/10.1136/bmj.i4919
  • 10 Higgins JP, Sterne JA, Savovic J, Page MJ, Hróbjartsson A, Boutron I, et al. A revised tool for assessing risk of bias in randomized trials. Cochrane Database Syst Rev. 2016;10(Suppl 1):29-31.

Publication Dates

  • Publication in this collection
    06 May 2024
  • Date of issue
    2024

History

  • Received
    20 Feb 2024
  • Reviewed
    20 Mar 2024
  • Accepted
    20 Mar 2024
location_on
Sociedade Brasileira de Cardiologia - SBC Avenida Marechal Câmara, 160, sala: 330, Centro, CEP: 20020-907, (21) 3478-2700 - Rio de Janeiro - RJ - Brazil, Fax: +55 21 3478-2770 - São Paulo - SP - Brazil
E-mail: revista@cardiol.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Acessibilidade / Reportar erro