Abstract: Large Language Models have emerged as the top-notch tool in the software engineering field, from requirement gathering and analysis to code generation. Several approaches have been developed ...
Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results