Search Articles

View query in Help articles search

Search Results (1 to 10 of 19 Results)

Download search results: CSV END BibTex RIS


Net Reproduction Number as a Real-Time Metric of Population Reproducibility

Net Reproduction Number as a Real-Time Metric of Population Reproducibility

The TFR does not account for mortality rates among childbearing-age women, possibly affecting population reproducibility [2,4]. These limitations reduce TFR’s ability to accurately reflect a country’s population replacement dynamics. Therefore, the net reproduction rate (Rt), the number of daughters a woman of childbearing age would produce under prevailing fertility and mortality conditions, is better.

Chiara Achangwa, Changhee Han, Jun-Sik Lim, Seonghui Cho, Sangbum Choi, Sukhyun Ryu

JMIR Public Health Surveill 2025;11:e63603

Accuracy of a Commercial Large Language Model (ChatGPT) to Perform Disaster Triage of Simulated Patients Using the Simple Triage and Rapid Treatment (START) Protocol: Gage Repeatability and Reproducibility Study

Accuracy of a Commercial Large Language Model (ChatGPT) to Perform Disaster Triage of Simulated Patients Using the Simple Triage and Rapid Treatment (START) Protocol: Gage Repeatability and Reproducibility Study

Reproducibility: variation in response with the use of different prompts with the same patient vignette. Diagnostic accuracy: overall accuracy of triage when compared to a documented reference standard. This study was based on a crossed gage repeatability and reproducibility (gage R and R) study with a comparison to a standard [9]. An easily approachable summary of this methodology is available on the American Society of Quality website [10].

Jeffrey Micheal Franc, Attila Julius Hertelendy, Lenard Cheng, Ryan Hata, Manuela Verde

J Med Internet Res 2024;26:e55648

Functional Impairment in Individuals Exposed to Violence Based on Electronical Forensic Medical Record Mining and Their Profile Identification: Controlled Observational Study

Functional Impairment in Individuals Exposed to Violence Based on Electronical Forensic Medical Record Mining and Their Profile Identification: Controlled Observational Study

We used Kendall W, or the coefficient of concordance [24,25], to measure reproducibility between raters for the same violent situation profiles. Kendall W was corrected for ties (see formula in the “Kendall W Coefficient of Concordance” section of Multimedia Appendix 1). For each physician, we randomly matched patients within the same violent situation profile and used Kendall W to measure the reproducibility of scales when a physician examined patients with the same violent situation profile.

Ivan Lerner, Patrick Chariot, Thomas Lefèvre

JMIR Public Health Surveill 2024;10:e43563

Using ChatGPT-4 to Create Structured Medical Notes From Audio Recordings of Physician-Patient Encounters: Comparative Study

Using ChatGPT-4 to Create Structured Medical Notes From Audio Recordings of Physician-Patient Encounters: Comparative Study

Therefore, the goal of this study was to use transcripts from simulated patient-provider encounters to determine the accuracy, readability, and reproducibility of Chat GPT-4–generated Subjective, Objective, Assessment, and Plan (SOAP) notes. As part of a project designed to evaluate the accuracy and efficacy of human scribe–generated notes, we created 14 simulated patient-provider encounters. All encounters used professional standardized patients and represented a wide range of ambulatory specialties.

Annessa Kernberg, Jeffrey A Gold, Vishnu Mohan

J Med Internet Res 2024;26:e54419

A Multidisciplinary Assessment of ChatGPT’s Knowledge of Amyloidosis: Observational Study

A Multidisciplinary Assessment of ChatGPT’s Knowledge of Amyloidosis: Observational Study

This study aims to build upon previous literature by using a multidisciplinary approach in assessing Chat GPT’s (1) accuracy in answering questions related to amyloidosis, particularly concerning cardiology, gastroenterology, and neurology; (2) reproducibility of responses; (3) readability; and (4) comparison of performance between Chat GPT-4 and Chat GPT-3.5.

Ryan C King, Jamil S Samaan, Yee Hui Yeo, Yuxin Peng, David C Kunkel, Ali A Habib, Roxana Ghashghaei

JMIR Cardio 2024;8:e53421

Examining and Comparing the Validity and Reproducibility of Scales to Determine the Variety of Vegetables Consumed: Validation Study

Examining and Comparing the Validity and Reproducibility of Scales to Determine the Variety of Vegetables Consumed: Validation Study

Reproducibility was assessed by test-retest reliability. Since each scale to determine vegetable variety was intended to be ranked, correlation coefficients were calculated. Furthermore, because the recorded variable distributions were determined not to be normally distributed by the histograms, the Spearman correlation coefficient was used to examine the validity and reproducibility. SPSS Statistics (version 27; IBM Corp) was used for analysis.

Kaya Ominami, Osamu Kushida

JMIR Form Res 2024;8:e55795

Ambiguity in Statistical Analysis Methods and Nonconformity With Prespecified Commitment to Data Sharing in a Cluster Randomized Controlled Trial

Ambiguity in Statistical Analysis Methods and Nonconformity With Prespecified Commitment to Data Sharing in a Cluster Randomized Controlled Trial

We requested the raw data to reproduce the analyses (see definition of “reproducing” in Reproducibility and Replicability in Science [5]) and potentially use alternative corrected methods to reanalyze the data. Data were not shared with us. The authors stated that this decision was made “to ensure the integrity of ongoing research being conducted using the same dataset.”

Yasaman Jamshidi-Naeini, Lilian Golzarri-Arroyo, Deependra K Thapa, Andrew W Brown, Daniel E Kpormegbey, David B Allison

J Med Internet Res 2024;26:e54090

Machine Learning and Health Science Research: Tutorial

Machine Learning and Health Science Research: Tutorial

In general, throughout the study design process, documentation and preplanning are highly recommended for the sake of reproducibility of the work carried out. For a visual illustration of the research pipeline flowchart, see Figure 1. There are also existing pipelines such as MLOps and CRISP used in business and industry settings that may be adapted to health science research fields; however, this paper will follow a framework more commonly seen in health science research.

Hunyong Cho, Jane She, Daniel De Marchi, Helal El-Zaatari, Edward L Barnes, Anna R Kahkoska, Michael R Kosorok, Arti V Virkud

J Med Internet Res 2024;26:e50890

Open Science and Software Assistance: Commentary on “Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened”

Open Science and Software Assistance: Commentary on “Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened”

The generation of fake data is of particular concern since reproducibility has never been prioritized. Code sharing is very much optional in most publication venues, and data sharing agreements for reproducing results are as complicated as they have always been. Chat GPT is not the creator of these issues; it instead enables this problem to exist at a much larger scale.

Pedro L Ballester

J Med Internet Res 2023;25:e49323

Generate Analysis-Ready Data for Real-world Evidence: Tutorial for Harnessing Electronic Health Records With Advanced Informatic Technologies

Generate Analysis-Ready Data for Real-world Evidence: Tutorial for Harnessing Electronic Health Records With Advanced Informatic Technologies

Although a few reporting guidelines regarding code-variable mapping and time windows have been proposed to improve the transparency and reproducibility of RWE [17,18], no clear data curation or statistical analysis guidelines have been developed. Harnessing unstructured data, such as clinical notes and images, can provide a more granular view of a patient’s health status that is not captured in structured data and can expand the availability of critical data for RWE generation.

Jue Hou, Rachel Zhao, Jessica Gronsbell, Yucong Lin, Clara-Lea Bonzel, Qingyi Zeng, Sinian Zhang, Brett K Beaulieu-Jones, Griffin M Weber, Thomas Jemielita, Shuyan Sabrina Wan, Chuan Hong, Tianrun Cai, Jun Wen, Vidul Ayakulangara Panickan, Kai-Li Liaw, Katherine Liao, Tianxi Cai

J Med Internet Res 2023;25:e45662