Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Roots looks for configuration at /etc/roots/config.yaml by default. You can specify an alternative path with the --config flag. This will prompt you for the essential settings and create the config ...

Markdown Editor: Added a powerful Markdown editor with real-time preview and synchronized scrolling. Toggleable via the bottom bar.