Extraction and appraisal workbook for a systematic review of large language models in first-contact primary health care
Study-level extraction, quality appraisal and risk-of-bias data for a systematic review of large language models (LLMs) used for diagnostic, triage and referral decision support in first-contact primary health care. The dataset covers 71 studies published in English between 1 January 2022 and 1 June 2026, identified by searching PubMed/MEDLINE, Embase (Ovid), Scopus and Web of Science Core Collection on 2 June 2026, together with backward citation searching.
Nine sheets hold the analytic record. Descriptive extraction of study characteristics, technology, evaluation design and outcomes. A five-domain appraisal developed by the author covering clinical realism, trustworthiness, safety, equity and implementation readiness. A reporting-framework appraisal scored on a common eight-item set across MI-CLAIM, STARD-AI, TRIPOD-LLM, DECIDE-AI and FUTURE-AI. A corroborative risk-of-bias layer using QUADAS-2 and PROBAST+AI. Model-level results for studies evaluating more than one model or metric, 334 rows in total. A summary matrix, a full codebook defining every field and banding rule, and reviewer notes recording each borderline decision and its resolution.
Extraction and appraisal were conducted by a single reviewer with a documented validation and correction pass. All ratings are the author's own judgements applied to published study reports and record reporting adequacy rather than the quality of the technologies evaluated. The workbook contains no personal or identifiable data.
Files are provided as an Excel workbook and as one CSV per sheet with formulas resolved to values. The dataset accompanies an MSc Public Health project report submitted to the London School of Hygiene and Tropical Medicine in September 2026.
Keywords
large language models; Generative artificial intelligence; Primary Health Care; First-contact care; Triage; Diagnostic decision support; Clinical decision support systems; Systematic review; Quality appraisal; Risk of bias| Item Type | Dataset |
|---|---|
| Resource Type |
Resource Type Resource Description Dataset Quantitative |
| Description of data capture | Data were extracted from published study reports, not collected from participants. Four bibliographic databases were searched on 2 June 2026 (PubMed/MEDLINE, Embase (Ovid), Scopus and Web of Science Core Collection), with backward citation searching of included reports. Records were screened on title and abstract and then at full text against protocol eligibility criteria. For each of the 71 included studies, a single reviewer extracted study characteristics and outcomes into a structured workbook with a predefined codebook, then applied a five-domain appraisal developed by the author, a reporting-framework appraisal scored on a common eight-item set, and a corroborative risk-of-bias assessment using QUADAS-2 and PROBAST+AI. A documented validation and correction pass followed. All values are either as reported in the source study or the reviewer's own coded judgement, as distinguished in the codebook. |
| Capture method | Compilation/Synthesis, Aggregation |
| Collection Period |
From To 2 June 2026 24 August 2026 |
| Date | 2 September 2026 |
| Language(s) of written materials | English |
| Creator(s) |
Dadazhanov, S |
| LSHTM Faculty/Department | Faculty of Public Health and Policy > Dept of Global Health and Development |
| Participating Institutions | London School of Hygiene & Tropical Medicine, London, United Kingdom; Imperial College London, London, United Kingdom |
| Date Deposited | 03 Sep 2026 11:17 |
| Last Modified | 03 Sep 2026 11:17 |
| Publisher | London School of Hygiene & Tropical Medicine |
Data / Code
-
subject - Data
-
- Available under Creative Commons: Attribution 4.0
-
info - Full extraction and appraisal workbook. Nine sheets covering the codebook, descriptive extraction, five-domain appraisal, reporting-framework appraisal, model-level results, summary matrix and risk-of-bias assessment for 71 included studies
grid_on - application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
- folder_info
- 836kB