Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Abstract: Technical advancements and expertise have progressed significantly compared to previous centuries, demanding efficient and fast methods for acquiring knowledge. This work explores the ...