The Need For RECORD?

The rapid entry of health care into the electronic age has led to a proliferation of large data repositories of health-related information. Such data are collected for administrative and clinical purposes, without specific a priori research questions. Examples of these “routinely collected health data” include health administrative data, electronic medical records, primary care surveillance data and disease registries. These data are increasingly being used for observational, comparative effectiveness and health services research. This expanding research area and the growing numbers of publications have generated increasing interest in specific methodological issues regarding the use of such data for research purposes.

At present, there is a lack of clarity regarding the strengths, limitations and biases of available electronic data sources. This confusion has been compounded by incomplete or inadequate reporting of research based on routinely collected health data in the literature.

The establishment of reporting guidelines is associated with improved quality of research reporting (1). An international collaboration recently produced the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement to improve reporting of observational research (2, 3). The STROBE statement has been endorsed and is being used by a wide range of journal editors, researchers and consumers of research (4). Since most research using routinely collected health data is observational in design, the STROBE guidelines should apply to these studies. However, due to the general nature of STROBE, specific issues related to reporting research using routinely collected data are not addressed. No reporting guidelines specifically addressing reporting of this type of research were identified in the Library for Health Research Reporting of the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network (5). Three checklists have been published to aid in the conduct and critical-appraisal of studies using routinely collected data for comparative-effectiveness research (CER), one of which specifically framed retrospective database research in the context of the STROBE guidelines (6-8). However, the following issues limit the usefulness of these checklists: a) they focus primarily on the methods of such research and less on reporting, b) they are specific to CER and do not apply to most observational research, c) they have not been widely endorsed by journal editors and d) they were not developed with international stakeholder consensus or as part of a formal extension of STROBE.

Extensions of the STROBE guidelines have been produced for genetic association studies (9) and molecular epidemiology research (10). Formal reporting guidelines for studies using routinely collected health data, with multi-disciplinary expert stakeholder involvement and collaboration from STROBE methodologists, will ensure the transparency of the methods used in this growing field of research.

To gauge the interest and feasibility of producing such a guideline amongst the users of routinely collected health data, we conducted a workshop following the Infectious Disease Research Network (IDRN) Primary Care Database Symposium 2012 (January 27, 2012 in London, UK). Over 100 participants (including 5 conveners of the STROBE initiative) participated in the workshop. Strong interest was expressed in the possibility of developing a reporting guideline specific to research using routinely collected health data.

Participants at the workshop identified unique issues in database research which are frequently unreported in the literature, including (but not limited to): description of database characteristics, validation of disease identification algorithms, validation of codes to identify both exposures and outcomes and methodology of linkage of patient records between databases. As a result of the lack of specific guidance, both participants of the workshop and members of the STROBE steering committee have agreed that there is a need for development of the RECORD guideline and both groups will be involved in the formal process. Finally, the Journal of Clinical Epidemiology and Clinical Epidemiology published editorials from the RECORD Steering Committee to address the need for such a guideline (11,12) (see Publications Tab), indicating the interest of journal editors in complete and transparent reporting of this field of research.

We have therefore decided to proceed with a formal guideline development process, in close conjunction with members of the STROBE group, to ensure consistent methods and to make this a useful extension to the original STROBE statement.

References

  • 1.Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;11:MR000030.
  • 2.Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, Poole C, Schlesselman JJ, Egger M. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007 Oct 16;4(10):e297.
  • 3.von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007 Oct 16;4(10):e296.
  • 4.Altman DG, Egger M, Gotzsche PC, Pocock SJ, Vandenbroucke JP, von Elm E. STROBE Statement: Endorsements. [Webpage] Bern: ISPM - University of Bern; 2009 [updated 2009; cited 2012 February 14]; Available from: http://www.strobe-statement.org/index.php?id=strobe-endorsement.
  • 5.Equator Network: Enhancing the Quality and Transparency of Health Research. [Webpage] Oxford: Minervation Ltd.; 2011 [updated 2011 Aug 9; cited 2012 January 28]; Available from: http://www.equator-network.org.
  • 6.Berger ML, Mamdani M, Atkins D, Johnson ML. Good research practices for comparative effectiveness research: defining, reporting and interpreting nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part I. Value Health. 2009 Nov-Dec;12(8):1044-52.
  • 7.Motheral B, Brooks J, Clark MA, Crown WH, Davey P, Hutchins D, Martin BC, Stang P. A checklist for retrospective database studies--report of the ISPOR Task Force on Retrospective Databases. Value Health. 2003 Mar-Apr;6(2):90-7.
  • 8.Peterson AM, Nau DP, Cramer JA, Benner J, Gwadry-Sridhar F, Nichol M. A checklist for medication compliance and persistence studies using retrospective databases. Value Health. 2007 Jan-Feb;10(1):3-12
  • 9.Little J, Higgins JP, Ioannidis JP, Moher D, Gagnon F, von Elm E, Khoury MJ, Cohen B, Davey-Smith G, Grimshaw J, Scheet P, Gwinn M, Williamson RE, Zou GY, Hutchings K, Johnson CY, Tait V, Wiens M, Golding J, van Duijn C, McLaughlin J, Paterson A, Wells G, Fortier I, Freedman M, Zecevic M, King R, Infante-Rivard C, Stewart A, Birkett N. STrengthening the REporting of Genetic Association Studies (STREGA): an extension of the STROBE statement. PLoS Med. 2009 Feb 3;6(2):e22.
  • 10.Gallo V, Egger M, McCormack V, Farmer PB, Ioannidis JP, Kirsch-Volders M, Matullo G, Phillips DH, Schoket B, Stromberg U, Vermeulen R, Wild C, Porta M, Vineis P. STrengthening the Reporting of OBservational studies in Epidemiology - Molecular Epidemiology (STROBE-ME): an extension of the STROBE Statement. PLoS Med. 2011 Oct;8(10):e1001117.
  • 11.Benchimol EI, Langan S, Guttmann A. Call to RECORD: the need for complete reporting of research using routinely collected health data. J Clin Epidemiol. 2012 Nov 24.
  • 12.Langan SM, Benchimol EI, Guttmann A, Moher D, Petersen I, Smeeth L, Sorensen HT, Stanley F, Von Elm E. Setting the RECORD straight: developing a guideline for the REporting of studies Conducted using Observational Routinely collected Data. Clinical epidemiology. 2013;5:29-31.