Natural Language Test Creation

Natural Language Test Creation

Describe the Test.
Pie Runs It.

Create automated tests in plain English. No selectors to configure. No scripts to maintain. No code to debug. Just describe what you want tested and watch it execute.

Try it free See how it works
Results in minutes Zero code required
<60s
Prompt to running test
90%
Less effort vs scripting
0
Lines of code required
Live
Watch execution in real-time

Test scripts take hours.
Prompts take seconds.

Traditional test automation means learning frameworks, writing code, debugging selectors, and maintaining scripts that break with every UI change. Pie flips the model.

Traditional
With Pie
Create test
2-4 hours
< 1 minute
Skills needed
Selenium, Cypress...
Plain English
Maintenance
20-40 hrs/month
Self-healing

How It Works

Create. Validate. Automate.

Build tests in plain English, verify they work live, then let Pie run them on every release.

1

Write in Plain English

Describe the test like you'd explain it to a teammate. No special syntax required.

"Test checkout with an expired credit card"
"Verify admin can't access user-only pages"
2

Watch It Execute Live

Pie's AI agent navigates your app using computer vision. See every click, every assertion in real-time.

Navigating to checkout...
Entering expired card...
Verifying error message...
3

Get Clear Results

Pass or fail with screenshots, execution replay, and step-by-step reasoning.

Test Passed
Error message displayed correctly.

Real Examples

Just Tell Pie What to Test

Real prompts. Real tests. No syntax to memorize.

Authentication
"Navigate to Register. Enter a unique email, create password 'Test123!', accept terms, click Sign Up. Log out. Return to Login, enter same credentials, sign in. Verify dashboard loads."

Tests complete signup → logout → login flow with verification

E-commerce
"Go to Shop > Products. Add first item to cart. Increase quantity to 2, verify total updates. Checkout with test card 4111111111111111."

Full checkout flow with quantity updates and payment

CMS
"Go to Admin > Content > Pages. Create page with unique title, add body text, set to Draft, save. Search for the page, change to Published, save. Verify it appears in Published list."

Create, update, and verify content publishing workflow

Edge Case
"Navigate to Contacts. Create contact with unique name. Search for it, select it, click Delete. Confirm deletion. Search again and verify no results found."

Create-delete-verify pattern for data integrity testing

Pro tips for great prompts

  • Use > for navigation: Settings > Users > Roles
  • Say "unique email" or "unique name" for auto-generated data
  • End with "verify" for explicit assertions

Use Cases

Test What Automated Tools Can't

Discovery builds your baseline. Custom Tests handle the scenarios that require domain knowledge.

Edge Cases

Boundary values, special characters, Unicode input, maximum field lengths. The inputs that break apps in production.

"Enter 10,000 character description and submit"

Negative Testing

Invalid inputs, unauthorized access attempts, error handling. Verify your app fails gracefully.

"Try accessing /admin as a regular user"

Regression Tests

That bug you fixed last month? Create a test to make sure it stays fixed forever.

"Verify cart total includes tax for CA addresses"

Smoke Tests

Critical path validation after every deploy. Know within minutes if login, checkout, or core flows work.

"Complete full checkout with saved payment method"

Feature Flags & A/B Tests

Test both variants of an experiment. Verify feature flags enable/disable correctly.

"Test checkout flow with new_ui flag enabled"

Manual Test Migration

Upload your spreadsheet of manual test cases. Pie converts them into automated tests.

Import from CSV, Excel, or TestRail

Iterative Testing

Your First Prompt Doesn't Need to Be Perfect

Watch the test run live. See exactly what the agent does. If it takes a wrong turn, add clarification and rerun. The agent adapts to your feedback.

No debugging scripts. No hunting through logs. Just iterate until the test does exactly what you need.

Initial prompt
"Test the Safe Zone feature"
Agent feedback

Tapped circle button instead of square. Buttons are visually similar.

Your clarification
"The delete button is under the three-dot menu"
Test passes

Safe Zone feature tested successfully. Test saved to regression suite.

Complete Coverage

Discovery Builds the Foundation.
Custom Tests Fill the Gaps.

Autonomous Discovery

Point Pie at your app. We explore every feature, every flow, every edge of your UI. In hours, you have a regression suite that would take weeks to build manually.

  • 100+ tests generated automatically
  • Core user flows covered
  • Regression baseline established

Custom Tests

You know things about your app that no AI can discover on its own. Custom Tests let you encode that domain knowledge into your test suite.

  • Edge cases only your team knows
  • Specific bugs from customer reports
  • Complex business logic validation

Both run together in your regression suite. Import existing test cases. Add new ones anytime.

Start Testing in Minutes

No scripts to write. No selectors to maintain. Describe what needs testing and watch it happen.

Try it free Talk to sales
SOC 2 Type 2 certified No source code access required

Frequently Asked Questions

Describe the test in plain English. 'Log in as admin, navigate to settings, change notification preferences, verify changes persist after logout.' Pie interprets the intent and executes it. No code, no selectors, no scripting language to learn.

You watch the test execute live. If the agent takes a wrong turn, add clarification and rerun. Most tests work correctly on the first or second attempt. The agent learns from your feedback.

They're complementary. Discovery generates your baseline test suite automatically. Custom Tests let you add specific edge cases, regression scenarios, and tests for flows only your team knows about. Both run together in your regression suite.

Yes. Upload a CSV of your manual test bank and Pie converts them into executable automated tests. No rewriting required.

Most tests complete in 2-5 minutes. You can watch the entire execution live or let it run and review results later.

Web apps, iOS, Android, React Native, Flutter. If a human can interact with it, Pie can test it.