Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Anthropic's Claude Sonnet 4.6 matches Opus 4.6 performance at 1/5th the cost. Released while the India AI Impact Summit is on, it is the important AI model ...