The AI Testing System

Using the PTP Methodology

A comprehensive training program on building an end-to-end AI-powered testing system. Transform how you approach software testing—moving from manually writing tests to orchestrating AI agents that create, review, automate, execute, and maintain your test suite.

PTP logo Playwright logo AI logo

This course includes

PTP starter repository with prompt templates

10 hands-on exercises

Private community access

Certificate of completion

Skill Level
Intermediate
Duration
2-3 days
Projects
2
Prerequisites
Basic testing concepts, familiarity with AI coding assistants

About this course

A comprehensive training program on building an end-to-end AI-powered testing system using the PTP (Product Testing Prompts) methodology. This course transforms how you approach software testing—moving from manually writing tests to orchestrating AI agents that create, review, automate, execute, and maintain your test suite.

You’ll build a complete PTP System that evolves alongside your application, covering the full lifecycle from test creation through intelligent maintenance.

Why This Course Is Different

Most AI testing courses teach you prompts and tools—you're still doing the work, just faster. This course teaches you to think differently: to become the orchestrator who leads a team of AI agents.

Course Difference

With PTP, you're not learning another tool—you're learning to structure information, design processes, and direct AI so that its natural behaviour aligns with your goals. You leave as someone who directs your team of AI agents, not someone who writes tests. The PTP System you build is multimodal (visual + audio + text AI), covers the complete testing lifecycle, and self-maintains as your application evolves.

Skills You'll Develop

  • Design and implement a complete PTP System for any application
  • Generate comprehensive test cases from video recordings using multimodal AI
  • Conduct voice-based test case reviews with AI conversational agents
  • Automate test cases to Playwright without manual coding
  • Implement intelligent bug vs broken test determination
  • Build self-maintaining test suites that evolve with your application
  • Apply Higher-Level Thinking techniques for effective AI orchestration
  • Create custom prompt libraries for your testing domain
  • Integrate PTP workflows with CI/CD pipelines

Syllabus

PTP Training Syllabus

A syllabus designed to take you from understanding the orchestration mindset to building a complete self-maintaining AI testing system

Module 1: The Orchestration Mindset

Why traditional AI testing courses miss the point—and how to think differently.

  • From “doing the work” to “directing your team of AI agents”
  • The three-tier prompt system: PRD → PRP → PTP
  • Behaviour specification vs implementation prescription
  • Setting up your PTP development environment
  • Lab: Create your first PRD → PRP → PTP workflow

Module 2: CREATE - Video-to-Test Generation

Using multimodal AI to generate comprehensive test cases from application recordings.

  • Recording application walkthroughs for test capture
  • AI visual analysis of user flows and interactions
  • Automatic edge case identification from observed behaviour
  • Structuring test case output for downstream automation
  • Lab: Record a user flow and generate a complete test suite

Module 3: REVIEW - AI Audio Agent Collaboration

Implementing voice-based test case review with AI conversational agents.

  • ElevenLabs integration for voice interaction
  • Conversational review patterns for test cases
  • Human-in-the-loop approval workflows
  • Refining test cases through natural dialogue
  • Lab: Conduct a voice-based review session for a test suite

Module 4: AUTOMATE - Seamless Test Automation

Converting manual test cases to executable Playwright automation.

  • Direct conversion from test cases to automation code
  • Automatic selector generation and Page Object Model creation
  • Framework-ready code generation patterns
  • Handling complex interactions and dynamic elements
  • Lab: Automate a complete test suite from PTP-generated test cases

Module 5: EXECUTE - Comprehensive Test Execution

Running your automated suite with full data capture and analysis.

  • Execution strategies for different testing phases
  • Capturing logs, screenshots, and performance metrics
  • Parallel execution optimization
  • Results aggregation and failure categorization
  • Lab: Execute a test plan with full evidence capture

Module 6: VALIDATE - Intelligent Results Analysis

The key differentiator: AI that determines if it’s a bug or a broken test.

  • Automatic comparison of expected vs actual behaviour
  • Bug vs broken test determination algorithms
  • Smart recommendations for fixes
  • Severity classification and triage automation
  • Lab: Analyze test failures and generate fix recommendations

Module 7: APPLY - The Self-Evolving Test Suite

Closing the loop with automated improvements and maintenance.

  • Applying validation recommendations automatically
  • Self-maintaining tests that adapt to application changes
  • The agentic test loop: continuous evolution with your product
  • Version control strategies for test case changes
  • Lab: Implement an automated improvement cycle

Module 8: Higher-Level Thinking Techniques

Advanced prompting patterns for working effectively with AI testing agents.

  • Iteration vs Refinement (Shooting vs Stacking)
  • Document Consistency Analysis (WHAT vs HOW documents)
  • Information Architecture (WHO/WHAT/WHEN/WHERE framework)
  • Agent orchestration patterns for complex workflows
  • Lessons Learned Loops for continuous improvement
  • Lab: Build a custom prompt library for your testing domain

Student Projects

Project 1: Complete PTP System Setup

  • Build an end-to-end PTP System for a sample application covering all six stages: CREATE, REVIEW, AUTOMATE, EXECUTE, VALIDATE, and APPLY
  • Implement the three-tier prompt system (PRD → PRP → PTP) with working templates

Project 2: Self-Maintaining Test Suite

  • Create a test suite that automatically adapts to application changes
  • Implement the agentic test loop with intelligent bug vs test failure determination and automated fix application

Resources Provided

  • PTP starter repository with complete prompt templates
  • PRD, PRP, and PTP template library
  • ElevenLabs voice review configuration guides
  • Playwright automation patterns and Page Object templates
  • Sample test artifacts demonstrating all six stages
  • Higher-Level Thinking prompt library
  • CI/CD integration scripts for continuous testing
  • Video recording and analysis workflow guides

Meet The Creator Of The Course

  • Bill Echlin, Test Automation Specialist
  • 15+ years implementing testing solutions at enterprises including Glencore and Nisa Investments
  • Creator of the PTP (Product Testing Prompts) methodology and the GTM framework
  • A fascination for working out the simplest way to explain complex topics

Career Benefits

  • Transform your role — Move from test executor to AI orchestrator directing automated testing workflows
  • Multiply your output — Achieve 80% reduction in test creation time while improving coverage
  • Future-proof your skills — Lead the shift toward AI-native testing in your organization
  • Increase team impact — Enable non-technical team members to contribute to test strategy

Course Format

  • Structured 2-3 day curriculum
  • 10 hands-on exercises with real-world complexity
  • 2 student driven projects to apply what you've learnt
  • Private community for ongoing support
  • Certificate of completion for your professional profile

Frequently Asked Questions

Do I need programming experience?

Basic familiarity with testing concepts is required, but no coding is needed. The PTP System generates automation code—you focus on strategy and orchestration.

How is this different from other AI testing courses?

Other courses teach you prompts and tips—you're still doing the work manually. PTP teaches you to build a complete system where AI handles the six-stage lifecycle (CREATE → REVIEW → AUTOMATE → EXECUTE → VALIDATE → APPLY). You direct the system; it does the work.

What makes the 'orchestration mindset' different?

Traditional thinking: 'What code do I need to write?' Orchestration mindset: 'What behaviour do I want from my AI agents?' You're thinking about process and commands that orchestrate the work, not doing the work yourself.

Will this work with my existing test framework?

Yes. PTP is framework-agnostic and works with Playwright, Cypress, Selenium, or any test framework. The methodology generates tests in your preferred format.

What AI tools are used in this course?

Claude for test generation and analysis, ElevenLabs for voice-based reviews, and various MCP integrations for connecting to your development environment. Free tiers are sufficient for all labs.

Can I use PTP alongside my current testing process?

Absolutely. Many teams start with PTP on new features while maintaining existing tests. The system integrates with standard Git workflows and CI/CD pipelines.

What's the relationship between PTP and GTM?

GTM (Git Test Management) provides the foundation for organizing test artifacts. PTP focuses on AI-powered test creation and maintenance. PTP includes GTM basics, but you can also take the dedicated GTM course for deeper coverage.

Do I get lifetime access to the course materials?

Yes. You'll have permanent access to the PTP starter repository, all templates, and the private community for ongoing support and updates.

Ready to Orchestrate AI Testing?

Ready to stop writing tests and start orchestrating AI? Join the growing community of QA professionals who've transformed their role from test executor to AI orchestrator. Enroll now and build a PTP System that creates, reviews, automates, executes, validates, and maintains your tests—while you direct the process from a higher level.

Enquire Now