Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Despite rapid generation of functional code, LLMs are introducing critical, compounding security flaws, posing serious risks ...