Abstract: Large Language Models have emerged as the top-notch tool in the software engineering field, from requirement gathering and analysis to code generation. Several approaches have been developed ...

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

According to Moderne, this extends OpenRewrite coverage from backend and frontend application code into the data and AI layer ...