Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Coffee doesn’t just feel like a magical elixir that reinvigorates your body, mind, and soul — some research shows that it actually does those things to some extent. You just have to brew it right, and ...