Tug of Watts: A study on the Energy - Accuracy Trade-off of Large Language Models on Medical Question Answering Tasks
This study examines the energy consumption and carbon footprint of 13 LLMs (270M to 14B parameters) on medical QA tasks from the OpenMedical-LLM leaderboard. It demonstrates how to estimate energy and emissions, and argu...