Frequently Asked Questions

Getting Started

Do I need to pay to use BugBrain?

No! BugBrain offers a 14-day free trial with full access to all Pro features. No credit card required. After the trial, you can downgrade to a free Starter plan or upgrade to a paid plan.

Do I need a credit card to sign up?

No credit card required for the trial. You only need one if you choose to upgrade to a paid plan after the trial expires.

What browsers does BugBrain support?

BugBrain tests web applications in Chrome/Chromium, which covers 95% of users. We plan to add Firefox and Safari support in the future.

Support for:

  • ✅ Chrome, Chromium-based browsers (Edge, Brave, Vivaldi)
  • ✅ Websites tested in Chrome
  • ❌ Native mobile apps (iOS/Android)
  • ❌ Desktop applications
  • 🔄 Firefox (coming soon)
  • 🔄 Safari (coming soon)

Can I use BugBrain on my CI/CD pipeline?

Yes! BugBrain integrates with:

  • GitHub Actions (native webhook)
  • GitLab CI (native webhook)
  • Jenkins (curl-based)
  • Any CI system that can make HTTP requests

Trigger tests on every commit, get results in your pipeline, block merges on failures. Learn more →

Test Cases & AI Generation

How many tests can the AI generate?

The free tier can generate up to 10 tests per request. Subsequent requests within the same minute are rate-limited (10/min). No monthly limit on how many tests you can generate overall.

Different on paid plans:

  • Starter: 10 tests per request, 100/month
  • Growth: 10 tests per request, 500/month
  • Pro: Unlimited tests, unlimited/month

How can I improve the quality of generated tests?

  1. Be specific — “Test login with valid credentials” vs “Test login”
  2. Include context — “Test checkout for guest users (no account)”
  3. Provide examples — Paste a user story or requirement
  4. Use your Knowledge Base — Add business rules, workflows, edge cases
  5. Review and edit — AI-generated tests are starting points; refine them

Can I import tests from CSV?

Yes! Go to Test Cases → Import. Supported formats:

  • CSV with columns: title, description, steps (JSON array)
  • JSON array of test case objects
  • TestRail exports (experimental)

What format do test steps use?

Test steps are natural language with optional JSON:

{
  "action": "navigate",
  "target": "https://app.example.com/login"
}
{
  "action": "fill",
  "target": "email field",
  "value": "user@example.com"
}
{
  "action": "click",
  "target": "Sign In button"
}
{
  "action": "assert",
  "target": "page contains Welcome"
}

Or simple natural language:

1. Navigate to login page
2. Enter email user@example.com
3. Enter password
4. Click Sign In
5. Verify dashboard loads

Test Execution

How long do tests take to run?

Most tests complete in 5–15 seconds:

  • Simple login: 2–3 seconds
  • Multi-step form: 8–12 seconds
  • Complex workflow (10+ steps): 20–30 seconds

Varies by:

  • Page load time (your app’s performance)
  • Number of steps
  • Wait times and waits between actions
  • LLM model used

Why did my test fail?

BugBrain automatically classifies failures into 8 categories:

  1. selector_changed — UI element moved or hidden
  2. api_error — Backend returned error (4xx/5xx)
  3. timeout — Test took too long
  4. assertion_mismatch — Expected ≠ actual
  5. environment_issue — Network/DNS/SSL error
  6. auth_failure — Login rejected
  7. data_state_issue — Required data missing
  8. flaky_infrastructure — Rate limiting, service degraded

Check the Failure Intelligence Panel on the Execution Detail page for AI-generated diagnosis and fix suggestions. Learn more →

Can I re-run a failed test?

Yes! Click “Re-run” on the Execution Detail page or from the Executions list. Tests are idempotent (safe to run multiple times) if they use fresh data.

What execution providers are available?

Two options:

Browser-Use Local — Self-hosted on your server

  • Port 8000
  • Full control, data stays on your network
  • Requires infrastructure management

Browser-Use Cloud — Managed by BugBrain

  • Zero infrastructure
  • Global CDN, automatic scaling
  • Best for most teams and CI/CD

Both use the same AI agent; choose based on your network access and infrastructure preference.

Authentication Testing

Do I need Mailosaur to test OTP codes?

Yes, to test email OTP flows, you need:

  • Mailosaur account (mailosaur.com)
  • Mailosaur API key + server ID
  • Test email address (e.g., qa+test@example.mailosaur.com)

Mailosaur intercepts test emails and exposes OTP codes via API. BugBrain calls the API automatically during test execution.

Alternative: Use magic links (one-use login links) which also use Mailosaur but are simpler.

Can I test TOTP / Google Authenticator?

Yes! Add the TOTP secret (base32 seed) to a Persona:

  1. Extract TOTP seed from authenticator app or QR code
  2. Create Persona with auth_type: "totp" and the seed
  3. BugBrain generates correct codes on the fly

How do I set up session caching?

Sessions are cached automatically. After first login, subsequent runs reuse the session for 8 hours. No setup needed.

To disable caching:

  • Delete the persona from cache (Settings → Personas → [persona] → Clear Session)
  • Or rotate the persona credentials

Can I log in as multiple users in one test?

Yes! Use multiple personas in a single test:

Step 1: Login as Admin (Persona: QA-Admin)
Step 2: Create something
Step 3: Logout
Step 4: Login as User (Persona: QA-User)
Step 5: Verify access

Billing & Plans

What’s the difference between plans?

FeatureStarterGrowthPro
Test executions/month100500Unlimited
Team members15Unlimited
Projects3UnlimitedUnlimited
AI test generationLimited500/monthUnlimited
IntegrationsSlack, EmailAll (12+)All (12+)
Self-healing❌✓✓
SupportEmailSlack24/7 Priority
PriceFree$99/mo$299/mo

View detailed comparison →

Can I upgrade or downgrade anytime?

Yes! Your next billing cycle reflects the change. Unused credits are prorated.

Upgrade: Instant, full access immediately. Downgrade: Takes effect on next renewal date.

What’s the refund policy?

30-day money-back guarantee. If you’re not satisfied, we’ll refund your payment, no questions asked. Contact support@bugbrain.tech.

Do you offer annual plans?

Yes! Pay annually and save 20%. Switch from monthly to annual anytime.

How long is the free trial?

14 days of full Pro features. No credit card required. After 14 days, downgrade to free Starter or upgrade to a paid plan.

Integrations

Can I connect multiple Slack channels?

Yes! Create multiple Slack integrations in the same project, each pointing to a different channel:

Integration 1: #qa-tests (all test results)
Integration 2: #critical-failures (only failures)
Integration 3: #nightly-runs (scheduled tests)

Each integration can have its own filters and notification settings.

How do I set up CI/CD webhooks?

  1. Go to Settings → CI/CD
  2. Generate CI/CD Token
  3. Copy Webhook URL and Secret
  4. Add to your GitHub Actions / GitLab CI / Jenkins config
  5. Tests trigger automatically on push/PR

Full setup guide →

Can I verify webhook signatures?

Yes! Every webhook includes a HMAC-SHA256 signature. Verify it to ensure the webhook came from BugBrain:

const crypto = require('crypto');
const signature = req.headers['x-hub-signature-256'];
const payload = JSON.stringify(req.body);
const secret = process.env.BUGBRAIN_WEBHOOK_SECRET;
const computed = 'sha256=' + crypto
  .createHmac('sha256', secret)
  .update(payload)
  .digest('hex');
if (signature !== computed) throw new Error('Invalid signature');

Webhook reference →

Troubleshooting

Tests are running slowly

Check these in order:

  1. App performance — Is your website slow? (check DevTools)
  2. Network — Good internet connection?
  3. Browser-Use Local — High CPU/memory usage?
  4. LLM model — Cheaper models are slower; try Claude Sonnet

Typical: 5–15 seconds per test. If longer, investigate.

”Element not found” error keeps happening

Likely cause: Selector changed. Fix:

  1. Update selector to use [data-testid] attributes
  2. Ask developers to add data-testid for test stability
  3. Use more generic selectors (e.g., “button contains Sign In”)
  4. Increase wait timeout

Troubleshooting guide →

Sessions not caching

Check:

  1. Is Persona auth type correct (basic, otp, totp)?
  2. Did login succeed first time?
  3. Are credentials correct?
  4. Try “Clear Session” in Persona settings

Getting rate limited (429 error)

Too many tests running concurrently. Fix:

  1. Reduce test concurrency — Run fewer tests in parallel
  2. Stagger test plans — Don’t all start at same time
  3. Upgrade plan — Higher plans have higher limits
  4. Contact support — We can increase org-level limits

Account & Security

How is my data encrypted?

  • Credentials (passwords, TOTP secrets): AES-256-GCM at rest
  • In transit: HTTPS/TLS
  • In logs: Passwords never logged
  • Access control: Organization isolation, team-level permissions

Can BugBrain employees see my credentials?

No. Your credentials are encrypted with keys you control (organizational keys). Even BugBrain staff cannot decrypt them.

How often do you back up data?

Daily automated backups to multiple regions. Database replication enabled. We maintain 99.99% uptime SLA.

Can I export my test cases?

Yes! API endpoint: GET /api/test-cases Export formats: JSON, CSV. API reference →

How do I delete my account?

Go to Settings → Account → “Delete Organization”. All data is deleted immediately. Cannot be undone.

Still have questions?

Contact us:

We’re here to help! 🚀