AgentMark’s CLI guides you through the process of setting up your AgentMark application. It will:

  • Create the agentmark.json configuration file.
  • Create your AgentMark client.
  • Create your AgentMark Cloud SDK.
  • Create example prompts, datasets, and evals.
  • Setup an example application, which you can use to test your platform.
  • Setup the basic API keys for your application.

Initializing AgentMark

You can initialize AgentMark by running the following command:

npx
npx @agentmark/cli@latest init -t cloud

Agentmark.json

The agentmark.json file is used to configure your AgentMark Cloud application.

agentmark.json
{
  "agentmarkPath": "/",
  "version": "2.0.0",
  "mdxVersion": "1.0",
  "builtInModels": ["gpt-4"]
}

agentmarkPath

The agentmarkPath property defines the base directory where AgentMark will look for your application’s resources including:

  • Prompt templates
  • Evaluation configurations
  • Datasets
  • Other AgentMark-specific resources

By default, this is set to ”/”, meaning AgentMark will look for the “agentmark” directory in your project root. You can modify this path if you want to organize these resources in a different directory structure (i.e. monorepo).

version

The version property is used to specify the version of the AgentMark configuration. This is useful for tracking changes and ensuring compatibility between different versions of your application.

mdxVersion

The mdxVersion property is used to specify the version of the MDX format. This is useful for tracking changes and ensuring compatibility between different versions of the MDX format.

builtInModels

The builtInModels property specifies which models are supported by AgentMark Cloud and available for use in your application. These models are pre-configured and ready to use without additional setup. You can add more models to this list with the npx @agentmark/cli@latest pull-models command.

Have Questions?

We’re here to help! Choose the best way to reach us: