Braintrust
AI engineering with prompts, datasets, experiments, evaluations, and logged runs.
Compares two prompt versions on the same dataset, and finds which experiment scored best before shipping it.
Use Braintrust with Snow
Snow is a personal AI assistant that builds real apps for you, and they can put Braintrust to work.
What Snow can do with Braintrust
These are the Braintrust operations Snow and the apps you build with it can run. Sign in to choose which ones Snow may run without asking.
Reads5
Look at your data without changing it.
- Fetch Events
Fetch one newest-to-oldest page of project log, experiment, or dataset events.
- Get Braintrust Resource
Get one project, experiment, dataset, prompt, or function by UUID.
- List Braintrust Resources
List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
- Query Braintrust Data
Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor unchanged.
- Summarize Experiment or Dataset
Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.
Creates3
Add something new to your account.
- Create Dataset
Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
- Create Experiment
Create an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.
- Create Project
Create a Braintrust project, or return the existing project unchanged when its name already exists.
Updates7
Change something that is already there.
- Create Prompt
Upsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submitted configuration. MCP attachments and tool-function bindings are unsupported.
- Insert Dataset Events
Upsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- Insert Experiment Events
Upsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- Update Dataset
Update the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
- Update Experiment
Update selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
- Update Project
Update selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
- Update Prompt
Update a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.
Deletes2
Remove something. This often cannot be undone.
- Delete Experiment, Dataset, or Prompt
Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
- Delete Project
Soft-delete a Braintrust project and return its deletion state.
Related integrations
Ready to put Braintrust to work?
Sign up free, build an app by chatting, and connect Braintrust in minutes. No credit card required.