laya-evals

Validates labelled JSONL, evaluates checkpoints, slices metrics, and fails on configured quality regressions.

Parent repository GitHub

Type: command
Repository: NandhaKishorM/laya
Readiness: Usable for evaluation and carefully validated deployments, but shipped calibration, multilingual task quality, option-order sensitivity, and workload-specific accuracy require local testing before automated actions.
Keywords: 6

Location

Repository path

research/evals/README.md

Invocation

laya-evals validate FILE; laya-evals run FILE [options]; laya eval ...

Setup

Installation / activation

Installed console command

Keywords

evaluationregressionJSONLaccuracyECECI

Repository context

NandhaKishorM/laya

Apache-2.0 multilingual decision-model toolkit that provides Python and TypeScript SDKs, local CLI and HTTP serving, ONNX runtimes, framework integrations, evaluation harnesses, and an optional MCP server for fast typed choice, ordinal-score, and yes/no decisions; no native Claude Code plugin, hook, skill, or Claude-specific installation path is evidenced.

machine learningnatural language processingclassificationdecision routingmultilingual inferenceguardrailscontent moderationsupport automationmodel routingevaluation

Open full repository research