Overview

AgentMark’s CLI guides you through the process of setting up your AgentMark application. It will:

• Create the agentmark.json configuration file.
• Create your AgentMark client.
• Create your AgentMark Cloud SDK.
• Create example prompts, datasets, and evals.
• Setup an example application, which you can use to test your platform.
• Setup the basic API keys for your application.

​

Initializing AgentMark

You can initialize AgentMark by running the following command:

npx @agentmark/cli@latest init -t cloud

​

Agentmark.json

The agentmark.json file is used to configure your AgentMark Cloud application.

{
  "agentmarkPath": "/",
  "version": "2.0.0",
  "mdxVersion": "1.0",
  "builtInModels": ["gpt-4"]
}

​

agentmarkPath

The agentmarkPath property defines the base directory where AgentMark will look for your application’s resources including:

• Prompt templates
• Evaluation configurations
• Datasets
• Other AgentMark-specific resources

By default, this is set to ”/”, meaning AgentMark will look for the “agentmark” directory in your project root. You can modify this path if you want to organize these resources in a different directory structure (i.e. monorepo).

​

version

The version property is used to specify the version of the AgentMark configuration. This is useful for tracking changes and ensuring compatibility between different versions of your application.

​

mdxVersion

The mdxVersion property is used to specify the version of the MDX format. This is useful for tracking changes and ensuring compatibility between different versions of the MDX format.

​

builtInModels

The builtInModels property specifies which models are supported by AgentMark Cloud and available for use in your application. These models are pre-configured and ready to use without additional setup. You can add more models to this list with the npx @agentmark/cli@latest pull-models command.