Eyeball++

Eyeball-plus-plus is a ridiculously simple and fun way to evaluate LLM tasks. It’s an open source framework which LLM application builders can integrate with a single line of code. Once integrated, it displays stats on how their system is doing and creates markdown files with the most up to date status which can be committed to their repos. It also makes it fun to rate your system’s output by gamifying the data collection.