MASAI trial, 2025
Hernström, V. et al., Screening performance and characteristics of breast cancer detected in the Mammography Screening with Artificial Intelligence trial (MASAI), Lancet Digital Health 7(3):e175-e183, 2025. A randomised trial of 105,934 women in Sweden.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
MASAI trial, 2026
Gommers, J. et al., Interval cancer, sensitivity, and specificity comparing AI-supported mammography screening with standard double reading without AI in the MASAI study, Lancet 407(10527):505-514, 2026.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Eisemann et al., 2025
Eisemann, N. et al., Nationwide real-world implementation of AI for cancer detection in population-based mammography screening (PRAIM), Nature Medicine 31(3):917-924, 2025. 463,094 women in Germany; observational.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Three authors work for Vara, the AI vendor.
Dembrower et al., 2023
Dembrower, K. et al., Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study (ScreenTrustCAD), Lancet Digital Health 5(10):e703-e711, 2023. 55,581 women.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Part-funded by Lunit, the AI vendor.
Liu et al., 2019
Liu, X. et al., A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis, Lancet Digital Health 1(6):e271-e297, 2019.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Schwarcz et al., 2026
Schwarcz, D.B. et al., AI-Powered Lawyering: AI Reasoning Models, Retrieval Augmented Generation, and the Future of Legal Practice, Journal of Law and Empirical Analysis 3:220, 2026. A randomised trial with 127 law students.
OpenedPeer reviewedUniversity of Minnesota (abstract) (opens in a new tab) · Working paper (PDF) (opens in a new tab)
Vals Legal AI Report, 2025
Vals AI, Vals Legal AI Report, 27 February 2025. Some vendors tested were Vals customers (disclosed in the report).
OpenedVals AI (opens in a new tab)
Vals Legal Research, 2025
Vals AI, VLAIR: Legal Research, October 2025.
ReportedVals AI (opens in a new tab) · LawSites (opens in a new tab)
Martin et al., 2024
Martin, L. et al., Better Call GPT, Comparing Large Language Models Against Lawyers, arXiv:2401.16212, January 2024. Ten procurement contracts.
OpenedarXiv (opens in a new tab)
Vendor-affiliated: the authors work for Onit, which sells legal technology. A preprint.
LawGeex, 2018
LawGeex, AI vs Lawyers NDA study, February 2018, as reported by Artificial Lawyer, 26 February 2018.
ReportedArtificial Lawyer (opens in a new tab)
Vendor study: LawGeex sells contract-review AI.
US Treasury, 2024
US Department of the Treasury, Treasury Announces Enhanced Fraud Detection Processes, Including Machine Learning AI, Prevented and Recovered Over $4 Billion in Fiscal Year 2024, 17 October 2024. Self-reported.
OpenedUS Treasury (opens in a new tab)
Kim et al., 2020
Kim, S. et al., DATE: Dual Attentive Tree-aware Embedding for Customs Fraud Detection, Proceedings of KDD 2020, pp. 2880-2890. Five years of import data, with the World Customs Organization.
OpenedPeer reviewedAuthors' summary (GitHub) (opens in a new tab) · Conference paper (DOI) (opens in a new tab) · World Customs Organization (opens in a new tab)
BIS Project Aurora, 2023
BIS Innovation Hub Nordic Centre, Project Aurora: the power of data, technology and collaboration to combat money laundering across institutions and borders, 31 May 2023. Simulated data.
OpenedBIS (opens in a new tab) · Report (opens in a new tab)
Built with Lucinity, an anti-money-laundering software vendor.
PRAC, 2023
Pandemic Response Accountability Committee, Fraud Alert PRAC-2023-02, 30 January 2023: $5.4 billion in potentially fraudulent pandemic loans linked to over 69,000 questionable Social Security numbers. Data matching, not AI.
OpenedOversight.gov (opens in a new tab)
UK National Fraud Initiative, 2022
Cabinet Office, National Fraud Initiative Report, December 2022. Data matching, not AI.
OpenedGOV.UK (PDF) (opens in a new tab)
GDPval (OpenAI), 2025
Patwardhan, T. et al. (OpenAI), GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks, arXiv:2510.04374, 5 October 2025. 44 occupations.
OpenedarXiv (opens in a new tab)
Vendor research: OpenAI makes AI models.
Dell'Acqua et al., 2023
Dell'Acqua, F. et al., Navigating the Jagged Technological Frontier, HBS Working Paper 24-013, September 2023, as reported by MIT Sloan, 19 October 2023.
ReportedMIT Sloan (opens in a new tab)
Freeman et al., 2021
Freeman, K. et al., Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy, BMJ 374:n1872, 2021.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Dratsch et al., 2023
Dratsch, T. et al., Automation Bias in Mammography: The Impact of Artificial Intelligence BI-RADS Suggestions on Reader Performance, Radiology 307(4):e222176, 2023. 27 radiologists.
OpenedPeer reviewedPubMed abstract (opens in a new tab) · Journal article (DOI) (opens in a new tab)
Stanford HAI, 2024
Magesh, V. et al., Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools, Journal of Empirical Legal Studies 22:216-242, 2025. Summary by Stanford HAI, 23 May 2024.
OpenedPeer reviewedStanford HAI (opens in a new tab)
ACS Information Age, 2025
ACS Information Age, 7 October 2025: a government assurance review drafted with generative AI was found to contain fabricated references, and part of the fee was repaid.
OpenedACS Information Age (opens in a new tab)
METR, 2025
METR, Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity, 10 July 2025 (arXiv:2507.09089), with an update of 24 February 2026. A randomised trial with 16 experienced developers.
OpenedMETR (opens in a new tab) · METR update, 2026 (opens in a new tab)
Yao et al., 2024
Yao, S. et al., τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains, arXiv:2406.12045, June 2024.
OpenedarXiv (opens in a new tab)
AI-industry authors: Sierra builds customer-service AI agents.
TIGTA, 2025
Treasury Inspector General for Tax Administration, report 2025-308-022 on the IRS use of AI to select tax returns for examination, 19 May 2025.
OpenedTIGTA (PDF) (opens in a new tab)
Mercor, 2026
Barton, A. (Mercor Economics), Human Baselines for Benchmarks, October 2026. A task benchmark: twelve licensed US professionals on four realistic month-end tasks.
OpenedMercor blog (opens in a new tab) · Paper (PDF) (opens in a new tab)
AI-industry source: Mercor sells AI evaluation and training data. Not peer reviewed.