AgentMark’s CLI guides you through the process of setting up your AgentMark application. It will:
  • Create the agentmark.json configuration file.
  • Create your AgentMark client.
  • Create your AgentMark Cloud SDK.
  • Create example prompts, datasets, and evals.
  • Setup an example application, which you can use to test your platform.
  • Setup the basic API keys for your application.

​
Initializing AgentMark

You can initialize AgentMark by running the following command:
npx
npx @agentmark/cli@latest init -t cloud

​
Agentmark.json

The agentmark.json file is used to configure your AgentMark Cloud application.
agentmark.json
{
  "agentmarkPath": "/",
  "version": "2.0.0",
  "mdxVersion": "1.0",
  "builtInModels": ["gpt-4"]
}

​
agentmarkPath

The agentmarkPath property defines the base directory where AgentMark will look for your application’s resources including:
  • Prompt templates
  • Evaluation configurations
  • Datasets
  • Other AgentMark-specific resources
By default, this is set to ”/”, meaning AgentMark will look for the “agentmark” directory in your project root. You can modify this path if you want to organize these resources in a different directory structure (i.e. monorepo).

​
version

The version property is used to specify the version of the AgentMark configuration. This is useful for tracking changes and ensuring compatibility between different versions of your application.

​
mdxVersion

The mdxVersion property is used to specify the version of the MDX format. This is useful for tracking changes and ensuring compatibility between different versions of the MDX format.

​
builtInModels

The builtInModels property specifies which models are supported by AgentMark Cloud and available for use in your application. These models are pre-configured and ready to use without additional setup. You can add more models to this list with the npx @agentmark/cli@latest pull-models command.

​
Have Questions?

We’re here to help! Choose the best way to reach us: