Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Pydantic V2 is a ground-up rewrite that offers many new features, performance improvements, and some breaking changes compared to Pydantic V1.