Skip to main content

​
Deployment Modes

AgentMark supports two modes:

​
Local

Run everything on your machine with the CLI and SDK. No cloud account required.
  • Create prompts as .prompt.mdx files in your editor
  • Run prompts via CLI (agentmark run-prompt) or SDK
  • Run experiments against datasets with automated evaluators
  • View traces in your local dashboard at http://localhost:3000
  • Iterate with hot-reloading via agentmark dev
Local mode is ideal for development, prototyping, and teams that want full control over their data.

​
Cloud

Take your app to production. Once you sync your app, cloud features work automatically on top of your local workflow.
  • Production traces — Collect and explore traces from live traffic with filtering, search, and graph view
  • Datasets & annotation queues — Link production traces to datasets for regression testing, route them to annotation queues for human review
  • Scoring — Run automated evaluators against production data, track quality over time
  • Dashboards & alerts — Monitor costs, latency, error rates, and evaluation scores with customizable dashboards and real-time alerts
  • Visual prompt editor — Create and edit prompts in the browser, run them in the Playground
  • Team collaboration — Shared experiments, review workflows, role-based access, and version control with rollback
  • Enterprise — SSO (SAML), custom roles, app-level permissions, self-hosted data plane for data residency
Developers always get the local experience. Cloud adds visibility, collaboration, and production tooling.

​
Getting Started

Quickstart

Create your first project in under 5 minutes

Configuration

Configure your project and client

​
Have Questions?

We’re here to help! Choose the best way to reach us: