laya-serve

Self-hosted FastAPI inference service exposing Jev-compatible single and batch System One endpoints.

Parent repository GitHub

Type: service
Repository: NandhaKishorM/laya
Readiness: Usable for evaluation and carefully validated deployments, but shipped calibration, multilingual task quality, option-order sensitivity, and workload-specific accuracy require local testing before automated actions.
Keywords: 6

Location

Repository path

README.md

Invocation

LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve

Setup

Installation / activation

Installed service command

Keywords

HTTPFastAPIAPIsystemonebatchself-hosted

Repository context

NandhaKishorM/laya

Apache-2.0 multilingual decision-model toolkit that provides Python and TypeScript SDKs, local CLI and HTTP serving, ONNX runtimes, framework integrations, evaluation harnesses, and an optional MCP server for fast typed choice, ordinal-score, and yes/no decisions; no native Claude Code plugin, hook, skill, or Claude-specific installation path is evidenced.

machine learningnatural language processingclassificationdecision routingmultilingual inferenceguardrailscontent moderationsupport automationmodel routingevaluation

Open full repository research