Autonomous penetration testing: what runs alone and what needs a person
Autonomous penetration testing means AI software runs parts of a pentest with little human input. Autonomy is a spectrum, not a switch. Reading and comparing can run alone, risky actions should wait for approval, and out-of-scope actions should be blocked. A person should still set the scope and check the evidence for each finding before a report.
Autonomous penetration testing is a pentest in which AI software plans and runs some or all of the testing steps with little human input. Vendors define it as a full lifecycle at machine speed. Few say where it stops. This guide gives a working definition, a table of tasks by autonomy level, the risks, and a checklist to judge a vendor.
What does autonomous mean in a pentest?#
Autonomous means that software chooses the next action without a person approving it. In a pentest, that covers recon, request crafting, reading responses and deciding what to try next. It does not tell you whether a person set the scope, approved risky actions or checked the findings.
Autonomy is a spectrum with at least four points:
- Assisted: a person drives and the software suggests.
- Supervised: the software acts, and a person approves each risky step.
- Bounded autonomy: the software acts alone inside written limits, and a person checks the results.
- Unbounded: the software acts with no limits and no review. No responsible provider should sell this for a live system.
Our position is at the third point. We do not call our agents autonomous without human control. Excession Labs agrees the scope with you in writing, sets a tool rule for each scope, checks the evidence for each finding and writes the report.
Public examples show the state of the field. XBOW wrote that "an autonomous penetration tester has reached the top spot on the US leaderboard" on HackerOne, and also that its security team reviewed the findings before submission to comply with HackerOne's policy on automated tools (blog dated 24 June 2025). That claim is for the US leaderboard only. Even the headline example had a person in the loop.
How do autonomy levels compare, task by task?#
The table shows where each task usually sits. It is a design we recommend, not a standard.
| Task | Runs alone | Waits for approval | Blocked or done by a person |
|---|---|---|---|
| Read-only requests inside scope | Yes | ||
| Compare anonymous and signed-in responses | Yes | ||
| Read client-side JavaScript bundles | Yes | ||
| Write to test-owned records | Yes | ||
| Upload tests, password guessing | Yes, with bounds | ||
| Sending email or calling paid third-party APIs | Yes, cost stated | ||
| Any request to a host outside the written scope | Blocked | ||
| Deleting or changing real user data | Blocked | ||
| Deciding if a business rule was broken | Person | ||
| Rating severity and writing the report | Person |
These are the allow, ask and deny rules described in human-in-the-loop pentesting.
What can agents do alone?#
Agents run repetitive, read-heavy work well. Examples are mapping endpoints from an OpenAPI file, sending the same request as each role, and comparing the results. They also run in parallel. One agent can test each role while another reads the client bundle.
A finding from this work still needs proof. For a write, the proof is a read-back through a second session. Controls run beside the exploit request: a nonexistent ID, a wrong record type, another account's token. How agentic pentesting works describes the planner and workers.
Benchmarks give a limited view. In DARPA's AI Cyber Challenge final, teams found 54 of the 63 challenge synthetic vulnerabilities and patched 43 (DARPA, 8 August 2025). Those tasks test code analysis, so they say little about authorization flaws or business logic in your app.
What still needs approval or a person?#
Anything with a side effect, and anything that needs knowledge of your business. A write, a delete, a bulk email or a paid API call can cost money or change data. An agent cannot know which actions you allow unless the scope tells it.
People also decide three things that software does poorly:
- Whether a result breaks a business rule that only your team knows.
- Whether a finding has a real effect or is a misleading success response.
- How to rate severity and describe the fix.
The where AI pentesting falls short guide lists these limits in full. If something outside the scope looks relevant, the right move is to stop and ask.
What are the risks of autonomous pentesting?#
The main risks are scope drift, side effects, cost and false findings. Each has a control.
| Risk | What goes wrong | Control |
|---|---|---|
| Scope drift | The agent follows a link to a host you do not own | Deny rule on out-of-scope hosts, written authorization |
| Production impact | A write, a delete or a burst of requests harms the system | Test on staging first, test-owned data, stop conditions |
| Cost | Email, SMS or paid APIs run up a bill | Bounded tests with the cost stated in the scope |
| False findings | A 200 is reported as a flaw |
Evidence rule, controls, human evidence check |
| Secrets in logs | Credentials end up in saved evidence | Placeholders in reports, secrets manager for access |
Is AI pentesting safe in production? covers the production rules.
How do you judge an autonomous pentest vendor?#
Ask questions whose answers you can check. Edgescan's view is that some AI pentesting is expensive vulnerability scanning. Use these questions to tell the difference.
Vendor checklist
- What does each finding link to: a saved request and response, a browser capture, a read-back?
- Which actions run alone, which wait for approval, which are blocked? Can you see the rule list?
- Who checks each finding before the report, and what do they check?
- How does the vendor handle a finding that controls show to be misleading?
- What does the report say it did not test?
- Which environment is tested, and with which accounts?
- What does the vendor state about turnaround, price and coverage, and can it back each claim?
- Do you receive the evidence itself, and a summary too?
Treat claims of "all vulnerabilities", "no false positives" or "fully hands-free" as red flags. No test finds all vulnerabilities. Evaluating an AI pentest report shows how to read the output.
Where do we sit?#
We combine tool rules with a human evidence check. The lab's AI agents do the repetitive testing work under rules agreed in the scope. Excession Labs checks the evidence for each finding and writes the report. Methods include direct HTTP requests, browser-observed tests, review of client-side bundles and differential comparison of anonymous and signed-in callers.
The rules differ by scope, and they can be tighter for production. We publish no turnaround times, prices or benchmark scores for our agents. How it works lists the nine steps. The pilot page explains how to apply for a small, scoped test.
Questions
Is autonomous pentesting the same as a vulnerability scanner?
No. A scanner sends known patterns and lists potential issues. An autonomous pentest agent plans tasks, adapts to responses and tries to prove an effect. Some products sold as autonomous act much like scanners, so ask what evidence each finding carries.
Can an autonomous pentest replace a human tester?
For repetitive work, such as comparing what each role can read, agents can do most of the effort. Business rules, scope decisions and the final check of evidence still need a person. Our model keeps a person on those.
Does the lab run its agents without human control?
No. Excession Labs sets a rule for each tool in each scope: run alone, wait for approval, or blocked. It also checks the evidence for each finding and writes the report.
What is the biggest risk of an autonomous pentest?
Actions with side effects: writes, deletes, email sending, paid third-party calls and load. These need bounds, approval rules and test-owned accounts. Scope drift to hosts you do not own is the second risk.
Sources
- XBOW: The Road to Top 1: How XBOW Did It (24 June 2025) (checked 9 November 2026)
- DARPA: AI Cyber Challenge final results (8 August 2025) (checked 9 November 2026)
- NIST SP 800-115: Technical Guide to Information Security Testing and Assessment (2008, final) (checked 9 November 2026)
- OWASP Web Security Testing Guide (checked 9 November 2026)
- Edgescan: Why AI Penetration Testing is Just Expensive Vulnerability Scanning (checked 9 November 2026)