Evals on 4oh4/dev

Evals on 4oh4/dev https://4oh4.github.io/tags/evals/ Recent content in Evals on 4oh4/dev Hugo en-gb Sat, 31 Oct 2026 00:00:00 +0000 Testing Jev against three small LLMs on text classification and calibration https://4oh4.github.io/posts/2026-10-02-jev-vs-small-llms-text-classification/ Sat, 31 Oct 2026 00:00:00 +0000 https://4oh4.github.io/posts/2026-10-02-jev-vs-small-llms-text-classification/ I compared Jev, which TypeSafe AI describes as calibrated, with three small LLMs. It was cheaper and competitive on accuracy, but no better calibrated.