Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.agentmark.co/llms.txt

Use this file to discover all available pages before exploring further.

​
Deployment modes

AgentMark supports two modes:

​
Local

Run everything on your machine with the CLI and SDK. No AgentMark account required.
  • Create prompts as .prompt.mdx files in your editor
  • Run prompts via CLI (agentmark run-prompt) or SDK
  • Run experiments against datasets with automated evaluators
  • View traces in your local dev server at http://localhost:3000
  • Iterate with hot-reloading via agentmark dev
Local mode is ideal for development, prototyping, and teams that want full control over their data.

​
Cloud

Take your app to production. Once you sync your app, Cloud features work automatically on top of your local workflow.
  • Production traces — Collect and explore traces from live traffic with filtering, search, and graph view
  • Datasets & annotation queues — Link production traces to datasets for regression testing, route them to annotation queues for human review
  • Scoring — Run automated evaluators against production data, track quality over time
  • Dashboards & alerts — Monitor costs, latency, error rates, and evaluation scores with customizable dashboards and real-time alerts
  • Visual prompt editor — Create and edit prompts in the browser, run them in the Playground
  • Team collaboration — Shared experiments, review workflows, role-based access, and version control with rollback
  • Enterprise — SSO (SAML), custom roles, and app-level permissions. For data residency options, contact us.
The local workflow keeps working after you adopt Cloud. Your .prompt.mdx files, local traces, and agentmark dev stay unchanged — Cloud is additive.

​
Get started

Quickstart

Create your first project in under 5 minutes

Configuration

Configure your project and client

​
Have Questions?

We’re here to help! Choose the best way to reach us: