In the NEJM Image Challenge study, Claude 3.7 correctly diagnosed all 16 cases involving infants under 1 year old (100% accuracy), whereas physicians achieved only 49.6% accuracy in that age group.
Sources
- Multimodal large language models challenge NEJM image ... - PMC (pmc.ncbi.nlm.nih.gov)
- https://www.nature.com/articles/s41598-026-39201-3 (nature.com)
- https://www.researchsquare.com/article/rs-7175790/v1 (researchsquare.com)
- https://www.researchgate.net/publication/400654619_Multimodal_large_language_models_challenge_NEJM_image_challenge (researchgate.net)
More in Technology
- Patricia Shaw is an IEEE CertifAIEd AI ethics assessor.
- FrontierMath is a math benchmark whose difficult questions remain unpublished so that AI companies cannot train their models against them.
- Apollo lunar-module astronauts stood side by side only 16 inches apart, viewing the lunar surface through two two-square-foot windows.
- The CIA's Aquiline drone program was initially modeled on birds' flight characteristics but never became operational.
- NASA has targeted developing a 100-kilowatt nuclear reactor for use on the lunar surface.
- The average smartphone has more computing power than all of NASA had when it sent astronauts to the moon in 1969.