Glossary

A plain-English glossary of BugBrain terms — runs, verdicts, issues, oracles, signatures, confidence scores, the application knowledge graph, the Premium Agent, MCP server, and more.

Plain-English definitions of the terms used across BugBrain. Where a concept has its own page, the term links to it.

A#

Add-on — A metered capability that is off by default and enabled per workspace (its feature flag on and its quota above zero). The add-ons are PR automation, load testing, and AI / LLM app testing. See Plans & quotas.

AI agent — One of the autonomous components that explores your app, drives flows, and judges results. See How the AI works.

Application knowledge graph — BugBrain's learned map of your app: its pages (states) and the actions that move between them. It sharpens test selection and self-healing over time. See Application knowledge graph.

C#

Confidence score — A 0-to-1 measure of how sure the agent is about a step or an issue. Low confidence pushes a result toward INCONCLUSIVE rather than a false FAIL. See Issue confidence & dedup.

E#

Exploratory run — An open-ended run where the AI decides what to test, mapping pages and exercising high-value flows without a script. See Test runs.

F#

Feature flag — A platform switch that turns a capability on or off (and controls rollout). Add-ons and integrations are gated, in part, by feature flags.

Flaky test — A test whose result flips between pass and fail without a real change in the app. BugBrain detects flakiness and can quarantine unstable tests. See Self-healing tests.

I#

Integration — A connection to an external tool — an issue tracker where BugBrain files bugs, or a notifier where it sends alerts. See Integrations.

Issue — A problem a run surfaced (a broken interaction, console error, failed request, accessibility problem, and so on), with severity, category, and evidence. See Issues & bug triage.

M#

MCP server — The Model Context Protocol server that connects AI coding tools (Claude Code, Cursor, Codex) to BugBrain, exposing a scope-gated set of tools. See MCP server.

O#

Oracle — The check that decides whether what the agent observed is correct or a defect — the logic behind each PASS, FAIL, or INCONCLUSIVE verdict. See Test-run scoring.

P#

Premium Agent — BugBrain's premium browser-driving engine, powering premium runs and advanced self-healing. Always referred to as the Premium Agent. See Premium Agent.

Project — A target the agent tests: a reachable URL plus its settings, credentials, and knowledge. See Projects.

R#

Run — A single execution against a project (exploratory, a test case, a plan, scheduled, or triggered by a pull request). See Test runs.

S#

Self-healing — Re-resolving a locator that moved so a test keeps passing through UI change, instead of failing on a brittle selector. See Self-healing tests.

Signature — A stable fingerprint of an issue used to deduplicate it across runs, so the same defect isn't reported many times. See Issue confidence & dedup.

T#

Test case — A saved, repeatable check the agent runs the same way each time. See Test cases.

Test plan — A grouped set of test cases run together. See Test plans.

V#

Verdict (PASS / FAIL / INCONCLUSIVE) — The outcome of a check. PASS: confirmed correct. FAIL: definitively not met. INCONCLUSIVE: the agent couldn't confidently confirm or deny (element not found, CAPTCHA, low confidence) — used instead of forcing a false FAIL. See Test-run scoring.

W#

Workspace — Your organization in BugBrain: the account that holds projects, members, billing, and settings. (Also called the organization.)

Frequently asked questions

What's the difference between a run and a test case?

A run is one execution against a project — most often an open-ended exploratory run. A test case is a saved, repeatable check the agent runs the same way each time. Runs are for discovery; test cases are for regression coverage.

What does INCONCLUSIVE mean?

It's the third verdict alongside PASS and FAIL, used when the agent couldn't confidently confirm or deny a check — for example it couldn't find an element, a CAPTCHA blocked it, or confidence was too low. It deliberately avoids forcing a false FAIL.

What is the Premium Agent?

BugBrain's premium browser-driving engine, used for premium runs and advanced self-healing. It's always referred to as the Premium Agent in the product.

What is an oracle?

An oracle is the check that decides whether something the agent observed is correct or a defect — the logic that turns observations into a PASS, FAIL, or INCONCLUSIVE verdict.