betaStart Free
MCP prompt regression automation

Change the model or prompt without changing the promise.

Version positive, negative, boundary, and tool-use cases. Automate replay against every candidate and explain which behavior moved, why it matters, and whether it blocks release.

Golden casesStructured assertionsTool behavior
assistant-v12 → v13
$ prooflane-inspector prompt regression prompt-suite.json \
  --include-content \
  --report prompt-report.html

✗ 1/3 · Return-window policy · FAIL · 850 ms
✓ 2/3 · Credential-handling policy · PASS · 910 ms
✓ 3/3 · Billing-owner verification · PASS · 980 ms

2 pass · 0 drift · 1 fail · 0 error
Score 67 · required 100
Decision BLOCK
HTML report: prompt-report.html
Behavior coverage

Test what the agent must do—and must not do.

POSITIVE

Required outcomes

Verify useful responses, structured fields, citations, actions, and tool completion.

NEGATIVE

Forbidden behavior

Reject disallowed actions, secret disclosure, unsupported claims, and unnecessary tools.

BOUNDARY

Ambiguous edges

Test clarification, abstention, missing context, invalid input, and uncertain evidence.

TOOLS

Agent traces

Assert selected tool, call count, argument shape, order, and final task outcome.

JUDGING

Hybrid graders

Prefer deterministic assertions, then apply bounded rubrics only where semantics require them.

DIFF

Explain the change

Compare case evidence and trace behavior instead of reducing every change to one score.

Prompt Studio walkthrough

Turn an idea or incident into a permanent test.

Author cases visually, generate adversarial variants with AI, and promote stable behavior into a release gate.

Prompt StudioAuthor reusable cases, assertions, and regression suites visually.
Generate prompts with AICreate positive, negative, boundary, and adversarial cases directly in the product.
Workflow

A memory for expected agent behavior.

01

Capture

Convert incidents, requirements, and edge cases into versioned tests.

02

Assert

Define deterministic, schema, semantic, tool, and safety expectations.

03

Replay

Run the same cases across model, prompt, tool, or application changes.

04

Review

Accept intentional goldens or block regressions with trace-level evidence.

prooflane-inspector prompt regression prompt-suite.json \
  --include-content \
  --out prompt-report.json \
  --report prompt-report.html

Detailed CLI reports show the system instruction, input prompt, expected answer, observed model answer, and assertion explanation. Failed cases open expanded; credential-shaped values are redacted.

Prompt Regression CLI guide
Part of the spine

Behavior tests become stronger with adjacent evidence.

Keep the promise

Make every hard-earned fix permanent.

Turn expected behavior into a release gate your team can inspect.

Start using Prooflane free for 30 days. No credit card required.