Eval extension API

Supports custom experiment executors and subject adapters through documented interfaces and CLI dependency overrides.

Parent repository GitHub

Type: TypeScript module API
Repository: apache/maka
Readiness: Developer and tester prerelease; explicitly not intended for production use
Keywords: 5

Location

Repository path

packages/eval/README.md

Invocation

Implement `ExperimentExecutor` or `SubjectAdapter` and pass overrides to `runMakaEvalCli`.

Setup

Installation / activation

Programmatic composition by an embedding TypeScript application.

Keywords

APIexecutorsubject adapterTypeScriptextension

Repository context

apache/maka

Apache-2.0, local-first AI agent workspace with Electron desktop, TUI/non-interactive CLI, a shared Runtime Host, built-in coding tools, sandbox approval boundaries, durable append-only execution records, crash recovery, optional MCP and computer-use integrations, and a reproducible evaluation subsystem; it is a standalone alternative or companion to Claude Code, not a documented Claude Code extension.

software developmentAI agentslocal-first applicationsdeveloper toolsagent evaluationdesktop applicationsterminal applicationsmodel orchestrationruntime infrastructurecomputer use

Open full repository research