Google Research and DeepMind recently introduced MultiMedQA, an open-sourced large language model for medical purposes. The model also incorporates methodology for evaluating human model responses along several axes, including factuality, precision, potential harm, and bias.
Â
MultiMedQA provides datasets for multiple-choice questions, and for longer responses to questions posed by medical professionals, and non-professionals. These comprise the clinical topics datasets for MedQA, MedMCQA, PubMedQA, LiveQA, MedicationQA, and MMLU. In addition, a new dataset of curated, frequently searched medical inquiries called HealthSearchQA was added to improve MultiMedQA.
Â
It combines HealthSearchQA, a new free-response dataset of medical questions sought online, with six existing open-question answering datasets covering professional medical exams, research, and consumer queries. The HealthsearchQA dataset consists of 3375 frequently-asked consumer questions and was curated using seed medical diagnoses and their related symptoms.
Â
In its Google for India 2022 event, the company announced a collaboration with Apollo Hospitals in India to improve the use of deep learning models in x-rays and other diagnostic purposes. Google’s other health partnerships include Aravind Eye Care System, Ascension, Mayo Clinic, Rajavithi Hospital, Northwestern Medicine, Sankara Nethralaya, and Stanford Medicine, among others.















