
Researchers have developed AI-driven evaluation standards to enhance ageing-related interventions, aiming to improve health outcomes and longevity through personalized, reliable recommendations.
Researchers from the Yong Loo Lin School of Medicine at the National University of Singapore (NUS Medicine) and the Institute for Biostatistics and Informatics in Medicine and Aging Research at Rostock University Medical Center in Germany conducted a collaborative study on the use of advanced AI tools, such as Large Language Models (LLMs), to enhance the evaluation of ageing-related interventions and provide personalized recommendations. Their findings were published in the journal Ageing Research Reviews.
Ageing research generates vast amounts of data, making it challenging to assess the safety and effectiveness of interventions like new medications, dietary modifications, or exercise regimens. This study explored how AI can streamline data analysis with greater efficiency and accuracy. The researchers proposed a standardized framework to ensure AI systems produce precise, reliable, and comprehensible evaluations by effectively processing complex biological data.
Key Requirements for AI-Based Evaluations
The researchers identified eight critical requirements for effective AI-based evaluations:
- Correctness of the evaluation results. Data quality will be assessed for accuracy.
- Usefulness and comprehensiveness.
- Interpretability and explainability of the evaluation results. Clarity and conciseness of the results and the given explanations.
- Specific consideration of causal mechanisms affected by the intervention.
- Consideration of data in a holistic context:
- Efficacy and toxicity, and evidence for the existence of a large therapeutic window;
- Analyses in an “interdisciplinary” setting.
- Enabling reproducibility, standardization, and harmonization of the analyses (and of the reporting).
- Specific emphasis on diverse longitudinal large-scale data.
- Specific emphasis on results that relate to known mechanisms of aging.
Telling LLMs about these requirements as part of the prompting improved the quality of the recommendations they produced.
Real-World AI Applications in Ageing Research
Professor Brian Kennedy from the Department of Biochemistry & Physiology, and Healthy Longevity Translational Research Programme at NUS Medicine, who co-led the study, said, “We tested AI methods using real-world examples such as medicines and dietary supplements. We found that by following specific guidelines, AI can provide more accurate and detailed insights. For instance, when analyzing rapamycin, a drug often studied for its potential to promote healthy aging, the AI not only evaluated its efficacy but also provided context-specific explanations and caveats, such as possible side effects.”
“The study’s findings could have far-reaching effects,” added Professor Georg Fuellen, Director, Institute for Biostatistics and Informatics in Medicine and Ageing Research, Rostock University Medical Center, who co-led the study, “For healthcare, telling the AI about the critical requirements of a good response can enable it to find more effective treatments and make them safer to use. Generally, AI tools could design better clinical trials and help tailor health recommendations to each person. This research is a major step toward using AI to improve health outcomes for everyone, especially as they age.”
Moving forward, the team is now focusing on a large-scale study of how to best prompt AI models for longevity-related intervention advice, to evaluate their accuracy and reliability for a wide array of carefully designed benchmarks, that is, curated, high-quality data. The validation of such AI systems is specifically important because the longevity interventions may then be implemented by a large number of healthy people. Prospective studies will need to demonstrate that AI-based evaluations can accurately predict successful outcomes in human trials, paving the way for safer and more effective health interventions.
The team hopes to use their findings to make health and longevity interventions more precise and accessible, and ultimately improve the quality and duration of life. Collaboration between researchers, clinicians, and policymakers will be essential to establish robust regulatory frameworks, ensuring the safe and effective use of AI-driven evaluations.
Reference: “Validation requirements for AI-based intervention-evaluation in aging and longevity research and practice” by Georg Fuellen, Anton Kulaga, Sebastian Lobentanzer, Maximilian Unfried, Roberto A. Avelar, Daniel Palmer and Brian K. Kennedy, 4 December 2024, Ageing Research Reviews.
DOI: 10.1016/j.arr.2024.102617
Never miss a breakthrough: Join the SciTechDaily newsletter.
Follow us on Google and Google News.
1 Comment
This is very exciting,I’ve always been fascinated by anything different, new as there is so much we can do & now I’m scared I will die young as I smoke but unfortunately I have an addictive personality. I’ve aged just by my doctor taking away my hrt for my period & now it’s stopped before having a baby I’m in tears daily as was only 40. I’ve seen these machines that can tell you all sorts of things like a diagnostic machine .I never knew there was this type of invention. I would love to try anything new just to be active as bedbound. I exist I’m not living. The thought of being in water swimming exited me but so many years lost so young & so much ignorance from people I thought I could get help from instead I have fear of being controlled. I want to live again I hope I can find something that would benefit me,no matter how small.