Close Menu
    Facebook X (Twitter) Instagram
    Cloud Tech ReportCloud Tech Report
    • Home
    • Crypto News
      • Bitcoin
      • Ethereum
      • Altcoins
      • Blockchain
      • DeFi
    • AI News
    • Stock News
    • Learn
      • AI for Beginners
      • AI Tips
      • Make Money with AI
    • Reviews
    • Tools
      • Best AI Tools
      • Crypto Market Cap List
      • Stock Market Overview
      • Market Heatmap
    • Contact
    Cloud Tech ReportCloud Tech Report
    Home»AI News»AI helps researchers investigate how thousands of medical studies share code | MIT News
    AI News

    AI helps researchers investigate how thousands of medical studies share code | MIT News

    November 20, 2026
    Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
    AI helps researchers investigate how thousands of medical studies share code | MIT News
    Share
    Facebook Twitter LinkedIn Pinterest Telegram Email
    murf



    The data and code that underpin a research study can tell us what was actually done, and how. In a medical study, for example, how were patients selected for inclusion? How were missing values handled? How were the results evaluated? 

    Access to a study’s data and code help researchers to answer these questions, to examine the methods, and to build on the work. 

    “Studies involve many choices about how to prepare data, develop models, and evaluate performance. These are sometimes called ‘researcher degrees of freedom,’” says Tom Pollard, a research scientist at MIT’s Laboratory for Computational Physiology and Computer Science and Artificial Intelligence Laboratory. “The choices we make affect the results, and a methods section in a paper can only capture so much detail.”

    While sharing code can be a first step, in order for code to be understood and reused, it must be sufficiently structured and described. The problem is that, right now, there is little guidance for researchers on what constitutes a well-organized, well-described collection of code. 

    murf

    This is where an international team led by researchers at MIT and Dana-Farber Cancer Institute sought to help, by examining how code is currently shared in clinical prediction studies. Such studies develop or evaluate models to estimate patient outcomes, such as the risk of developing a disease. Because these models inform decisions about patient care, researchers need to be able to scrutinize how they were built and tested.

    Using large language models (LLMs), the researchers examined nearly 4,000 papers to identify statements about shared code. They then followed the statements to assess hundreds of associated code repositories.

    Their review revealed two key gaps: Code sharing remains uncommon, and making code public does not consistently mean providing the documentation and supporting information needed for reuse. The open-access findings, recently published in Nature Medicine, are informing TRIPOD-Code, a reporting guideline being developed to clarify what researchers should share.

    Following the code

    TRIPOD-Code builds on TRIPOD and TRIPOD+AI, checklists that help researchers report how clinical prediction models were developed and evaluated. To understand current code-sharing practices, the team identified studies citing either guideline. The review included almost 4,000 studies that developed, updated, or validated prediction models, and whose full texts were available through PubMed Central’s open-access collection. 

    “The challenge was that the information was highly inconsistent. First, we had to identify whether or not a paper shared code” says Thomas Sounack, the study’s first author. He adds that authors “discuss and link to code from a paper in many different ways.”

    The team used an LLM to help screen papers, identify statements about code availability, and extract links. Software then retrieved the linked repositories — online collections of code and related files — for further assessment.

    The workflow went beyond checking whether a link existed. It also assessed repositories against characteristics such as completeness of documentation, software requirements, and terms of reuse.

    “The real benefit of LLMs is their ability to process unstructured information such as text. These models helped us work with information that was scattered across papers and software repositories, rather than neatly organized in a table,” says Pollard, who is a senior author of the study. “That allowed us to examine how code was being shared in much more detail across a large collection of studies.”

    Human reviewers evaluated the work of the LLMs. Two researchers independently checked 500 papers and a separate sample of repositories, resolving disagreements before comparing their assessments with the automated results. 

    Agreement was stronger for concrete characteristics, such as whether a license file was present, than for judgments about the adequacy of documentation. Because classification errors remain possible, the authors emphasize the overall patterns rather than treating every count as exact.

    Inconsistent code sharing

    Only about 1 in 8 studies reported sharing code. Where code was shared, the contents of repositories varied widely.

    Some repositories were “extremely well-organized and -documented, while others gave almost no guidance at all,” Sounack says. Good code sharing, he explains, means “giving enough information to understand what the code does and be able to run it to reproduce the results reported in the paper.”

    Practices also varied substantially across journals and countries. Among journals, the proportion of studies sharing code ranged from zero to more than 70 percent. Some journals with low sharing rates nevertheless had written code-sharing policies, suggesting that policies alone may not be enough to motivate code sharing.

    The review also helped to identify examples of effective practice. Some researchers, for example, provided synthetic datasets to assist with code reuse where the original patient records could not be shared publicly.

    Setting a standard for code sharing

    Researchers who share code are already making an effort to make their work transparent. But clinical prediction research brings together people from medicine, statistics, and computer science, whose expectations for documenting and sharing code may differ.

    TRIPOD-Code aims to establish a consensus. Through an expert review process, the team is developing guidance on which elements of shared analytical code should be considered essential.

    “We want to give researchers practical guidance on how to share code, and give journals clearer expectations to communicate to authors,” Pollard says. “The review gives us evidence to inform those discussions.”



    Source link

    changelly
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

    Related Posts

    Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence

    November 19, 2026

    Claude Opus 5.5 Marked a School as a Target in 69% of Tests

    November 18, 2026

    Learning the language of machine learning | MIT News

    November 17, 2026

    Cmpnd Releases dspy-wsp: Weight-Space Programming Comes to DSPy

    November 16, 2026

    Chinese AI tied to banned chips, plus 4 more

    November 15, 2026

    Helping robots fit into the human workplace | MIT News

    November 14, 2026
    notion
    Latest Posts

    Ethereum’s Glamsterdam Upgrade Could Slip Into 2027 As 15,000 Smart Contracts Face Disruption

    November 20, 2026

    Solana’s Next Upgrade Could Break Existing Apps As Developers Face New Warning

    November 20, 2026

    Ethereum Glamsterdam Upgrade Could Be Delayed Until May 2027

    November 20, 2026

    Ethereum’s Phylax Security Tool Raises Censorship Concerns

    November 20, 2026

    Sweden’s H100 Reports $1.3M Q3 Loss, Seeks Share Buyback Approval

    November 19, 2026
    10web
    LEGAL INFORMATION
    • Privacy Policy
    • Terms Of Service
    • Social Media Disclaimer
    • DMCA Compliance
    • Anti-Spam Policy
    Top Insights

    Want $12,000 a Year in Dividends? Here’s the Capital the Goal Requires

    November 20, 2026

    AI helps researchers investigate how thousands of medical studies share code | MIT News

    November 20, 2026
    quillbot
    Facebook X (Twitter) Instagram Pinterest
    © 2026 CloudTechReport.com - All rights reserved.

    Type above and press Enter to search. Press Esc to cancel.

    bitcoin
    Bitcoin (BTC) $ 62,024.00
    ethereum
    Ethereum (ETH) $ 1,756.26
    tether
    Tether (USDT) $ 0.999165
    bnb
    BNB (BNB) $ 573.34
    usd-coin
    USDC (USDC) $ 0.999605
    xrp
    XRP (XRP) $ 0.962787
    solana
    Solana (SOL) $ 72.41
    tron
    TRON (TRX) $ 0.307376
    staked-ether
    Lido Staked Ether (STETH) $ 2,265.05
    figure-heloc
    Figure Heloc (FIGR_HELOC) $ 1.02