TileLang fast path

Optionally replaces supported CUDA forward operations with fused TileLang kernels and CUDA graphs.

Parent repository GitHub

Type: acceleration module
Repository: NandhaKishorM/laya
Readiness: Usable for evaluation and carefully validated deployments, but shipped calibration, multilingual task quality, option-order sensitivity, and workload-specific accuracy require local testing before automated actions.
Keywords: 6

Location

Repository path

README.md

Invocation

pip install laya[fast]; laya.load(..., fast=True) or agent.accelerate()

Setup

Installation / activation

fast=True or accelerate() on a loaded agent

Keywords

TileLangCUDAGPUaccelerationkernelsgraphs

Repository context

NandhaKishorM/laya

Apache-2.0 multilingual decision-model toolkit that provides Python and TypeScript SDKs, local CLI and HTTP serving, ONNX runtimes, framework integrations, evaluation harnesses, and an optional MCP server for fast typed choice, ordinal-score, and yes/no decisions; no native Claude Code plugin, hook, skill, or Claude-specific installation path is evidenced.

machine learningnatural language processingclassificationdecision routingmultilingual inferenceguardrailscontent moderationsupport automationmodel routingevaluation

Open full repository research