Agreement between AI models and physician majority vote on NEJM Image Challenge cases was low, with Cohen's kappa of 0.08 for both GPT-4o and Claude 3.7, and 0.24 for Doubao.
Sources
- Multimodal large language models challenge NEJM image ... - PMC (pmc.ncbi.nlm.nih.gov)
- https://www.nature.com/articles/s41598-026-39201-3 (nature.com)
- https://www.researchsquare.com/article/rs-7175790/v1 (researchsquare.com)
- https://www.researchgate.net/publication/400654619_Multimodal_large_language_models_challenge_NEJM_image_challenge (researchgate.net)
More in Technology
- The UNESCO Sites Navigator is an online geographic information system that displays georeferenced maps of UNESCO-designated sites.
- AI melanoma-diagnosis systems perform better on white skin than black skin, largely because their training data contains more examples of white skin.
- Each Lunar Orbiter carried two cameras—one high-resolution and one medium-resolution—and used 70-millimeter film rather than standard 35-millimeter film.
- RankRAG instruction-tunes a single large language model to perform both context ranking and answer generation for retrieval-augmented generation (RAG).
- The global automotive industry was projected to lose more than $110 billion in 2021 because of the microchip shortage.
- The first transistor was made in 1947.