Jivi, an Indian healthcare AI startup, co-founded by former BharatPe Chief Product Officer Ankur Jain, and GV Sanjay Reddy, Chairman, Reddy Ventures, has ranked number one on the Open Medical LLM (Large Language Model) Leaderboard.
Jivi MedX has beaten established LLMs, including OpenAI’s GPT-4 and Google’s Med-PaLM 2 with an average score of 91.65 across the leaderboard’s nine benchmark categories.
Hosted by leading AI platform Hugging Face, the University of Edinburgh, and Open Life Science AI, the leaderboard ranks medical-specific LLMs based on their performance in answering medical questions from exams and research.
The evaluation covers medical exams such as Indian medical entrance exams (AIIMS and NEET), US Medical License Exams (USMLE), and detailed assessments in clinical knowledge, medical genetics, and professional medicine, among others.
Ankur Jain said, Jivi is revolutionising primary healthcare through generative AI, making top-quality care accessible 24x7 at a fraction of the cost. Our mission at Jivi, is to harness artificial intelligence to enhance patient care. The platform accelerates diagnostics and ensures higher accuracy, enabling timely and precise treatment for all, he said.
Jivi currently operates with a lean, 20-member team of physicians, surgeons, AI engineers, and data scientists. It is developing technology to transform accessibility, affordability, and quality of healthcare globally.
Sanjay Reddy said, Jivi’s mission, is to make top-of-the-line healthcare available to everyone globally. Being the best LLM in the world gives the confidence as the company prepares Jivi for over a billion people.
Jivi uses its large proprietary medical dataset consisting of millions of medical research papers, journals, clinical notes, and other sources to train its Jivi MedX LLM. This dataset is among the largest in the world. Jivi MedX was trained using an instruction fine-tuning algorithm called Odds Ratio Preference Optimisation.