Leva

LLM Evaluation Framework for Rails apps to be used with production data.

Leva is a Ruby on Rails framework for evaluating Language Models (LLMs) using ActiveRecord datasets on production models. It provides a flexible structure for creating experiments, managing datasets, and implementing various evaluation logic on production data with security in mind.

Mounting it

# Gemfile
gem "leva"

# config/routes.rb
mount Leva::Engine, at: "/leva"

Details

142 stars on GitHub · MIT licensed · maintained by kieranklaassen. Source: https://github.com/kieranklaassen/leva