Prompt Management

Manage prompts centrally and A/B test them with zero latency.

Create and manage your prompts in the dashboard.

Python
TypeScript

Setup

Initialize the prompts module with your API key:

from fallom import prompts

prompts.init(api_key="your-fallom-api-key")

Basic Prompt Retrieval

from fallom import prompts

# Get a managed prompt (with template variables)
prompt = prompts.get("onboarding", variables={
    "user_name": "John",
    "company": "Acme"
})

# Use the prompt with any LLM
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[
        {"role": "system", "content": prompt.system},
        {"role": "user", "content": prompt.user}
    ]
)

The prompt object contains:

Field	Description
`key`	The prompt key
`version`	The prompt version
`system`	The system prompt (with variables replaced)
`user`	The user template (with variables replaced)

Prompt A/B Testing

Run experiments on different prompt versions:

from fallom import prompts

# Get prompt from A/B test (sticky assignment based on session_id)
prompt = prompts.get_ab("onboarding-test", session_id, variables={
    "user_name": "John"
})

# prompt.ab_test_key and prompt.variant_index are set
# for analytics in your dashboard

Version Pinning

# Use latest version (default)
prompt = prompts.get("my-prompt")

# Pin to specific version
prompt = prompts.get("my-prompt", version=2)

Automatic Trace Tagging

When you call prompts.get() or prompts.get_ab(), the next LLM call is automatically tagged with the prompt information. This allows you to see which prompts are used in your traces without any extra code.

# Get prompt - sets up auto-tagging for next LLM call
prompt = prompts.get("onboarding", variables={"user_name": "John"})

# This call is automatically tagged with prompt_key, prompt_version, etc.
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[
        {"role": "system", "content": prompt.system},
        {"role": "user", "content": prompt.user}
    ]
)

Setup

Initialize the prompts module with your API key:

import { prompts } from "@fallom/trace";

prompts.init({
  apiKey: "your-fallom-api-key",
});

Basic Prompt Retrieval

import { prompts } from "@fallom/trace";

// Get a managed prompt (with template variables)
const prompt = await prompts.get("onboarding", {
  variables: { userName: "John", company: "Acme" },
});

// Use the prompt with any LLM
const response = await openai.chat.completions.create({
  model: "gpt-4o",
  messages: [
    { role: "system", content: prompt.system },
    { role: "user", content: prompt.user },
  ],
});

The prompt object contains:

Field	Description
`key`	The prompt key
`version`	The prompt version
`system`	The system prompt (with variables replaced)
`user`	The user template (with variables replaced)

Prompt A/B Testing

Run experiments on different prompt versions:

import { prompts } from "@fallom/trace";

// Get prompt from A/B test (sticky assignment based on sessionId)
const prompt = await prompts.getAB("onboarding-test", sessionId, {
  variables: { userName: "John" },
});

// prompt.abTestKey and prompt.variantIndex are set
// for analytics in your dashboard

Version Pinning

// Use latest version (default)
const prompt = await prompts.get("my-prompt");

// Pin to specific version
const prompt = await prompts.get("my-prompt", { version: 2 });

Automatic Trace Tagging

When you call prompts.get() or prompts.getAB(), the next LLM call is automatically tagged with the prompt information. This allows you to see which prompts are used in your traces without any extra code.

// Get prompt - sets up auto-tagging for next LLM call
const prompt = await prompts.get("onboarding", {
  variables: { userName: "John" },
});

// This call is automatically tagged with promptKey, promptVersion, etc.
const response = await openai.chat.completions.create({
  model: "gpt-4o",
  messages: [
    { role: "system", content: prompt.system },
    { role: "user", content: prompt.user },
  ],
});

Getting Started

Features

TypeScript Integrations

Python Integrations

AI Coding Tools

No-Code Integrations

Prompt Management

Setup

Basic Prompt Retrieval

Prompt A/B Testing

Version Pinning

Automatic Trace Tagging

Setup

Basic Prompt Retrieval

Prompt A/B Testing

Version Pinning

Automatic Trace Tagging

Next Steps

Model A/B Testing

View Dashboard

​Setup

​Basic Prompt Retrieval

​Prompt A/B Testing

​Version Pinning

​Automatic Trace Tagging

​Setup

​Basic Prompt Retrieval

​Prompt A/B Testing

​Version Pinning

​Automatic Trace Tagging

​Next Steps

Model A/B Testing

View Dashboard

Setup

Basic Prompt Retrieval

Prompt A/B Testing

Version Pinning

Automatic Trace Tagging

Setup

Basic Prompt Retrieval

Prompt A/B Testing

Version Pinning

Automatic Trace Tagging

Next Steps