Skip to main content
LlamaIndex queries, retrievers, and agents are instrumented by the OpenInference LlamaIndex instrumentor, which captures model calls, retrieval steps, and tool calls as OTLP spans. Point the exporter at AgentMark and the traces arrive normalized.
OpenInference ships the LlamaIndex instrumentor for Python. For LlamaIndex.TS, instrument with a raw OpenTelemetry setup — see OpenTelemetry.

​
Setup

1

Install the instrumentor and the OTLP exporter

pip install openinference-instrumentation-llama-index \
  opentelemetry-sdk opentelemetry-exporter-otlp-proto-http
2

Point the exporter at AgentMark and instrument LlamaIndex

Use your AgentMark API key and app id from project settings.
from openinference.instrumentation.llama_index import LlamaIndexInstrumentor
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import BatchSpanProcessor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter

provider = TracerProvider()
provider.add_span_processor(
    BatchSpanProcessor(
        OTLPSpanExporter(
            endpoint="https://api.agentmark.co/v1/traces",
            headers={
                "Authorization": "<YOUR_API_KEY>",  # raw key, no "Bearer" prefix
                "X-Agentmark-App-Id": "<YOUR_APP_ID>",
            },
        )
    )
)

LlamaIndexInstrumentor().instrument(tracer_provider=provider)
3

Run your app

Run your LlamaIndex application as usual. Each model call, retrieval step, and tool call arrives in AgentMark as a span, grouped into a trace. See Traces and logs.

​
What AgentMark captures

LlamaIndex spans use the OpenInference attribute conventions — model, token usage, input and output messages, retrieval documents, tool calls, and span kind are all mapped onto AgentMark’s normalized trace fields, and token counts feed cost tracking. See OpenInference for the full attribute mapping.

​
Next steps

OpenInference

How AgentMark reads OpenInference attributes

Traces and logs

Explore traces once they arrive

​
Have questions?

Reach out any time: