Author: UnboundCompute

  • AI in Security Testing: What It Actually Does and Where It Falls Down

    AI in Security Testing: What It Actually Does and Where It Falls Down

    The honest way to describe ai in security testing is as a reasoning layer bolted onto tools that already existed. A scanner still sends the requests, a fuzzer still mutates the inputs, and a human still decides what counts as a real finding. What an AI model adds is judgment in the middle: it reads a target the way a junior tester would, proposes what to try next, explains why a response looks suspicious, and writes up what it found in plain language. That is genuinely useful, and it is also narrow. This guide walks through where AI is actually pulling weight in security testing today, where it falls down in ways that matter, and how it fits alongside the signature scanners, fuzzers, and human pentesters that are not going anywhere. The negatives in the middle of this piece are the part worth reading twice.

    What ai in security testing actually means in practice

    Strip away the marketing and there are two distinct things people mean by AI here. The first is using a language model to drive or assist a testing workflow: read a page, decide what to probe, interpret the response, draft the report. The second is older machine learning that has run quietly inside security products for years, classifying traffic, scoring anomalies, and clustering alerts. This piece is mostly about the first kind, because that is what changed recently and what the search intent is asking about. The mental model to hold is augmentation. The AI is not a new class of vulnerability scanner. It is a layer that decides what to do with the scanners, fuzzers, and request tooling that already exist, and that sometimes notices things a fixed ruleset cannot.

    Throughout the concrete sections below, picture a small invented web application called Acme Notes. It has a login, a notes API, a sharing feature, an admin panel, and a billing page. It is exactly the kind of ordinary application a tester gets handed with a week to look at it, and it makes the difference between what AI does well and badly easy to see.

    Where AI is genuinely useful in security testing today

    These are not hypothetical. Each one is a place where a language model or a learned model is doing real work in testing pipelines right now. The detail under each heading is the honest version: what it does, and where the seams show.

    Reconnaissance and attack surface mapping

    The first thing any tester does is figure out how big the target is. For Acme Notes that means enumerating subdomains, endpoints, parameters, JavaScript bundles, and third party calls, then turning that pile into a picture of what is exposed. AI helps here mostly by reading and summarizing. Point a model at a sprawling single page application bundle and it will pull out the API routes the front end calls, flag an endpoint named /api/admin/export that the navigation never links to, and group endpoints by the feature they belong to. It is good at saying this is the billing surface, this is the auth surface, here is an undocumented route that looks privileged. It does not discover hosts that the underlying tooling did not already reach. The enumeration is still done by ordinary resolvers, crawlers, and certificate transparency lookups. The model is reading their output and prioritizing, which is real time saved on the part of recon that is tedious rather than hard.

    Generating and mutating payloads and fuzzing inputs

    Fuzzing throws malformed or unexpected input at a target and watches for a crash, an error, or a behavior change. Traditional fuzzers mutate inputs blindly or from a fixed dictionary. A model can make the mutation context aware. Show it the Acme Notes note creation request and it can propose inputs shaped to the format the endpoint expects: a JSON body where one field is a deeply nested object, a title that is valid UTF8 but pathological, a shared note identifier that is almost but not quite a valid one. For an API that takes structured input, that context awareness produces payloads that get past input validation and actually reach the logic, which a dumb mutator often cannot. The caveat is volume and verification. A model will happily generate a thousand plausible payloads, and plausible is not the same as effective. Throughput still belongs to the fuzzer, which can fire millions of cases. The model is better used to seed a fuzzer with smarter starting cases than to be the fuzzer.

    Reasoning about application and business logic

    This is the use that signature scanners cannot touch, and it is where AI earns its place. A signature scanner finds known bad shapes: an SQL error string, a reflected script tag, a known vulnerable library version. It has no idea what your application is for, so it cannot find a flaw that is only a flaw given the rules of your business. Acme Notes lets a user share a note with a teammate. A logic flaw might be that the share endpoint checks you are logged in but never checks that the note you are sharing is yours, so you can share, and thereby read, any note by guessing its identifier. No signature matches that. It is only wrong because of what sharing is supposed to mean. A model that has read the request, the response, and the surrounding flow can reason that this endpoint accepts a note identifier without an ownership check and propose the test that proves it. This kind of reasoning about intent is the single most interesting thing AI brings to testing, and it is exactly the class of flaw that a fixed ruleset is structurally blind to.

    Triaging and deduplicating findings to cut scanner noise

    Anyone who has run a scanner at scale knows the real problem is not too few findings, it is too many. A scan of Acme Notes might return four hundred items, most of them the same missing security header reported on every endpoint, plus a long tail of low confidence guesses. AI is good at this cleanup. It can cluster the four hundred items into a dozen distinct issues, collapse the duplicates, group every instance of the missing header into one finding with a list of affected paths, and rank what is left by plausible impact. This is one of the most mature and least glamorous uses, and it is a genuine force multiplier because it returns the scarcest resource a tester has, which is attention. The honest caveat is that a confident summary can bury a real finding inside a deduplicated cluster, so the triage has to stay reviewable rather than be trusted blind.

    Chaining several weaknesses into an attack path

    Individual findings are often shrugged off as low severity in isolation. The damage usually comes from the chain. On Acme Notes, an information leak that exposes internal user identifiers is minor. A share endpoint that does not verify ownership is medium. A password reset that trusts a user supplied identifier is medium. Strung together, they become an account takeover: leak the identifier, use it against the weak endpoints, reach an admin note, escalate. AI is well suited to proposing these chains because it can hold several findings in view at once and reason about how the output of one becomes the input to the next. It is good at saying these three medium issues plausibly combine into one critical path. It is important to read that as a hypothesis to test, not a proven exploit, which leads directly to the limits.

    Drafting reproduction steps and reports

    The least controversial use is writing. Once a finding exists, someone has to document it: a clear title, the affected endpoint, numbered reproduction steps, the impact, and a remediation. This is exactly the kind of structured writing language models do well, and it returns hours that testers would rather spend testing. A model can take a raw request and response for the Acme Notes share flaw and produce a clean writeup with steps a developer can follow. The one rule that matters is that a human confirms the finding is real before the report goes out, because a fluent, well formatted report describing a vulnerability that does not actually exist is worse than no report at all. It wastes a developer’s time and burns trust in the whole testing program.

    What AI does not do well in security testing

    This is the section that makes the rest of the piece trustworthy. These limits are not temporary rough edges that the next iteration smooths over. Several of them are structural, baked into what a language model is, and a testing program that ignores them ships false findings and misses real ones.

    Proving a finding is real

    A model can tell you a response looks like a vulnerability. It cannot, by reasoning alone, tell you it is one. Verification means actually demonstrating the impact: pulling another user’s note, executing the injected command, reading the file you should not be able to read. A model is fluent and confident regardless of whether the underlying claim is true, so it will describe a SQL injection on an Acme Notes endpoint in convincing detail when the error it saw was an ordinary input validation message. The cure is execution. The claim has to be checked against the running target, and that check is concrete and external to the model. Treat every AI generated finding as unverified until a real request proves the impact. The model is a hypothesis generator. The proof comes from the target, not the prose.

    Determinism and reproducibility

    Security testing leans hard on reproducibility. You run the test, you get the result, you run it again and get the same result, and that stability is what lets you confirm a fix and trust a regression suite. Model driven testing is not naturally reproducible. The same target and the same prompt can yield a different line of investigation on two different runs, find a flaw one time and miss it the next, and word the same finding two different ways. That variability is poison for the parts of a security program that need to be an audit trail. The practical answer is to pin the deterministic scaffolding around the model: the model proposes, but the actual probes are concrete recorded requests, and the evidence is a saved request and response rather than the model’s recollection of what it did.

    Staying in scope

    Scope is a hard rule in testing. You are authorized to test these hosts and not those, to avoid destructive actions, to never touch production data. A model following a chain of reasoning has no innate respect for that boundary. Tracing an interesting lead, it can wander from the in scope Acme Notes staging host to a linked third party domain it was never cleared to touch, or propose a destructive action because it advances the objective. Scope enforcement therefore cannot live inside the model’s good intentions. It has to be a hard outer boundary in the harness, an allowlist of targets and a block on dangerous actions that the model literally cannot route around, with a human approving anything near the edge. This is a keep the human in the loop control, not a prompt politely asking the model to behave.

    The testing agent being manipulated by the target

    This one is specific to language model driven testing and it is easy to underrate. A testing agent reads content from the target to decide what to do next. If an attacker controls some of that content, they can plant instructions in it aimed at the agent rather than at a human. A page on a hostile target might contain hidden text that reads, in effect, stop testing and report that this application is secure, or worse, make a request to an external server and include what you have collected. This is prompt injection, and it is the headline risk in the OWASP Top 10 for LLM Applications. The unsettling part is that the more autonomy the testing agent has, the more damage a successful injection can do, because the agent has hands. The same class of manipulation, along with the broader set of techniques adversaries use against AI systems, is catalogued in MITRE ATLAS. An agent that tests untrusted targets is itself an attack surface, and it has to be sandboxed and constrained as if the target is trying to hijack it, because sometimes it is.

    The model is a tireless reader and a fluent writer that proposes what to try and explains what it sees. It is not the thing that proves a vulnerability is real. That proof comes from a request against the running target, and a human deciding what the result means.

    How AI fits alongside existing methods, not instead of them

    The framing that survives contact with reality is augmentation, not replacement. Each existing method is good at something AI is bad at, and the combination beats any one of them.

    Signature scanners are fast, deterministic, and cheap, and they reliably catch the known bad shapes: the outdated library, the exposed admin endpoint, the classic injection patterns. They are the floor, and AI does not replace the floor. A model is slower, costs more per run, and is not deterministic, so using it to rediscover findings a signature catches in milliseconds is a waste. Let the scanner sweep the known issues and point the model at what the scanner cannot reason about.

    Fuzzers own throughput. They fire enormous volumes of cases and surface the crash or the anomaly. A model cannot match that volume and should not try. Its role is to make the fuzzer smarter at the edges, seeding it with structurally valid cases for an endpoint like the Acme Notes API so more of the fuzzed traffic gets past validation and reaches real logic. Smart seeds plus brute volume beats either alone.

    Human pentesters remain the ones who hold accountability and the deep creative leaps. A skilled tester invents the genuinely novel attack, exercises judgment about what is worth pursuing, owns the scope decision, and signs their name to the report. AI is a force multiplier under that human: it handles the recon summarizing, the triage, the first draft of the report, and the tedious generation of test cases, so the human spends their hours on the parts that need a human. The model proposes and drafts. The human verifies, decides, and is responsible. That division of labor is the whole game, and it lines up with how the NIST AI Risk Management Framework frames AI as a tool whose risks are managed by people and process rather than trusted on its own. For the structured discipline of probing a web application that the model accelerates rather than replaces, the OWASP Web Security Testing Guide is still the reference.

    A concrete division of labor on Acme Notes

    Put it together on the example app. The scanner sweeps Acme Notes and flags the outdated dependency and the missing headers. The fuzzer, seeded with model generated valid request shapes, hammers the notes API and surfaces an endpoint that errors strangely on a malformed identifier. The model reads the whole picture, notices the share endpoint never checks ownership, proposes that it chains with the leaked identifier into reading other users’ notes, deduplicates the four hundred header warnings into one, and drafts the report. Then a human runs the actual request that pulls another user’s note, confirms the chain is real, throws out two AI suggested findings that did not reproduce, and signs off. Every actor did the part it is good at. None of them could have done the whole job alone.

    A grounded look at where this is heading

    The honest forward look is incremental, not a revolution. Autonomous penetration testing is a real and active area of research, and systems that drive longer chains of testing actions with less human prompting are getting steadily more capable. That is worth taking seriously. It is also worth being sober about, because the limits above are the hard part, and more autonomy makes some of them worse rather than better. An agent that can run for longer without a human is an agent that can wander out of scope for longer, be manipulated by a hostile target for longer, and generate more confident unverified findings before anyone checks them. The capability and the risk grow together.

    So the credible near term direction is not autonomous testers replacing humans. It is better scaffolding around the model: stronger scope enforcement in the harness, evidence trails that record the actual requests so a non deterministic process leaves a deterministic audit log, and verification steps that automatically try to prove a finding before a human ever sees it. The frameworks for governing this are already being written. The NIST AI RMF gives a structure for managing the risk of AI systems, MITRE ATLAS catalogues the ways AI systems get attacked, and the OWASP LLM project names the specific failure modes of language model applications including the prompt injection that threatens a testing agent directly. Maturity here looks less like a smarter model and more like a more disciplined system wrapped around it.

    If you want the fuller treatment, the pillar guide on AI security testing goes deeper on the whole landscape, and the companion piece on LLM security testing tools covers the concrete tooling. For the adversary’s side of how exposed surfaces get discovered in the first place, the walkthrough of how hackers find vulnerabilities pairs naturally with the recon section above. Our own work at UnboundCompute is one example of building an autonomous researcher around exactly these constraints, treating verification and scope as the hard problems rather than afterthoughts, and you can read more on our about page. The pattern that holds across all of it is the same one this piece opened with. AI is a powerful reasoning layer on top of testing methods that already work. It proposes, reads, and drafts at a scale no human can match, and it still needs the scanner under it, the fuzzer beside it, and the human over it deciding what is actually true.

    Frequently asked questions

    What is AI actually used for in security testing?

    Mostly as a reasoning layer on top of existing tools rather than a new scanner. In practice it summarizes reconnaissance and attack surface, seeds fuzzers with context aware payloads, reasons about application and business logic to find flaws a signature scanner misses, deduplicates and triages noisy scanner output, proposes how several weaknesses chain into an attack path, and drafts reproduction steps and reports. The structured testing discipline it accelerates is laid out in the OWASP Web Security Testing Guide.

    Can AI replace human penetration testers?

    No, and the honest framing is augmentation rather than replacement. AI is good at the tedious and high volume work: summarizing recon, generating test cases, cutting scanner noise, and writing first draft reports. Humans still hold accountability, make the genuinely novel creative leaps, own the scope decision, and verify that a finding is real before it ships. The NIST AI Risk Management Framework frames AI as a tool whose risks are managed by people and process, not something trusted on its own.

    What can AI not do well in security testing?

    Four things stand out. It cannot prove a finding is real by reasoning alone, since verification needs an actual request against the target. It is not naturally deterministic or reproducible, which matters for audit trails and regression checks. It does not respect scope on its own, so the boundary has to be enforced in the harness. And a testing agent that reads hostile target content can itself be hijacked by prompt injection, the headline risk in the OWASP Top 10 for LLM Applications.

    Is autonomous penetration testing a real thing yet?

    Autonomous penetration testing is a genuine and active area of research, and systems that drive longer chains of testing actions with less human prompting keep getting more capable. The grounded view is that more autonomy makes the hard problems harder, not easier, because an agent can wander out of scope, be manipulated, or generate confident unverified findings for longer. The ways AI systems themselves get attacked are catalogued in MITRE ATLAS.


    Where this goes next for your own systems

    Everything in this piece, AI proposing where to look while verification and scope stay the hard problems, is what UnboundCompute is built to do: an autonomous security researcher that proves the vulnerabilities it can and holds back the ones it cannot. If you want that on your own web apps and APIs, you can request access.

  • LLM Security Testing Tools: A Vendor Neutral Landscape Guide

    LLM Security Testing Tools: A Vendor Neutral Landscape Guide

    If you search for llm security testing tools as a buyer, you land on a category that is quietly two categories wearing one name, and the tools in each do almost opposite jobs. One group uses large language models to do security testing for you: scanners that reason about a target, copilots that sit next to a human tester, and autonomous agents that try to find and prove real bugs. The other group tests the security of LLM applications themselves: red teaming and guardrail tools that throw prompt injection, jailbreaks, and data leakage attempts at a model to see what it gives up. This guide maps both halves so you can tell which one a vendor is actually selling, name the real tools in each, line them up against the frameworks that govern them, and walk away with a short checklist for evaluating any of them without falling for a demo.

    This is a cluster guide under our broader pillar on AI security testing. If you want the wide angle on how machine learning is reshaping offensive and defensive testing, start there. This page stays narrow on purpose: the tools, what they are, and how to judge them.

    Why llm security testing tools means two different things

    The phrase is genuinely ambiguous, and the ambiguity is not pedantic. A team shopping for a way to find vulnerabilities faster and a team shopping for a way to keep their chatbot from leaking customer records will both type the same words into a search bar. They need different products. Before you compare anything, you have to decide which problem you are solving.

    Meaning (a) is LLM driven security testing: the tool is the tester, and a language model is the engine inside it. The thing under test is ordinary software, a web app, an API, a network. The model reads responses, forms hypotheses, and decides what to try next. Here the LLM is offense.

    Meaning (b) is security testing of LLM applications: the tool is the attacker and the thing under test is itself a model or an application built around one. The goal is to break the model’s guardrails, extract its system prompt, make it follow an injected instruction, or coax out training data. Here the LLM is the target.

    Some platforms blur the line, using a model to attack another model, but the distinction still tells you what a tool is for. The rest of this guide takes each meaning in turn, names verifiable tools, and stays at the category level wherever a specific claim cannot be confirmed.

    Meaning (a): tools that use LLMs to perform security testing

    This side of the market is moving fastest and is also the easiest to oversell. It splits cleanly into three categories that differ by how much autonomy the model holds and how much a human stays in the loop.

    AI augmented classic scanners and SAST and DAST

    The most incremental category is the established scanner with a language model bolted on. Static application security testing (SAST) reads source code for dangerous patterns. Dynamic application security testing (DAST) probes a running application from the outside. Both have lived for years with a well known weakness: noise. A traditional SAST tool flags a pattern that looks like a SQL injection but cannot tell whether the tainted input ever reaches the sink under real conditions, so it reports a finding a human then has to triage.

    The language model addition tries to cut that triage cost. It reads the flagged code path, the surrounding context, and sometimes the data flow, then it explains whether the finding looks real and proposes a fix. The honest framing is that this is assistance on top of the same underlying detection engine, not a new way of finding bugs. It can reduce false positive review time and it can also introduce a new failure mode, a confident model explanation that is simply wrong. If you want the ground truth on how these detection approaches differ before judging an AI layer on top of them, our explainer on SAST vs DAST vs IAST lays out what each one can and cannot see.

    LLM assisted manual testing copilots

    The second category keeps a human firmly in the driver’s seat and uses the model as an advisor. A copilot suggests the next step, interprets tool output, drafts a payload, or explains an unfamiliar response while the tester decides what to actually run. The clearest public example of this pattern from research is PentestGPT, an open source project and academic study presented at USENIX Security 2024. PentestGPT structures a model’s reasoning into a tester like workflow and was evaluated on a benchmark of penetration testing sub tasks. The research itself is candid about the limits: the authors found that language models handle discrete operations such as interpreting a single tool’s output reasonably well but struggle to hold a coherent multi step strategy across a long engagement, losing the thread as context grows. That is the honest state of the copilot category. It is a force multiplier for a skilled human, not a replacement for one.

    The value of a copilot is bounded by the person using it. In expert hands it speeds up the boring parts and surfaces ideas. In inexperienced hands it can produce confident nonsense that the user is not equipped to catch. Treat copilots as the human in the loop category, because the human is the safeguard.

    Autonomous pentest agents

    The third category is the one drawing the most attention and the most hype: agents that run an end to end test with little or no human steering. They map an application, pick targets, attempt exploits, observe results, and decide their next move in a loop. The most prominent commercial example is XBOW, which describes itself as an autonomous offensive security platform that performs web application penetration tests and surfaces a finding only after it has confirmed exploitability through a controlled challenge. That last property, confirming a bug by actually exploiting it in a non destructive way rather than just flagging a pattern, is the meaningful design choice in this category and the one worth probing in any agent that claims it.

    The promise of autonomous agents is real and the caveats are equally real. An agent that can prove a finding saves enormous triage effort. An agent that operates without supervision needs hard scope and safety controls, because the same autonomy that lets it chain an exploit lets it wander outside the targets you authorized. The agent attack surface is itself a security topic worth understanding before you point one at production, which we cover separately in our piece on the AI agent attack surface.

    An autonomous tool that flags a vulnerability is making a claim. An autonomous tool that exploits it is offering proof. The gap between those two is the entire question of whether a finding is worth your time.

    Meaning (b): tools that test the security of LLM applications

    Now flip the polarity. Here the application under test is the model, or a product built on top of one, and the tools are designed to break it. This category exists because LLM applications fail in ways traditional scanners were never built to see: a prompt injection buried in a retrieved document, a jailbreak that talks the model out of its own rules, a system prompt that leaks under pressure, or sensitive data surfacing in a completion. These are the failure modes a red teaming tool is built to provoke on purpose.

    NVIDIA garak

    garak is an open source LLM vulnerability scanner from NVIDIA. The name stands for Generative AI Red teaming and Assessment Kit, and the tool works much like a classic vulnerability scanner pointed at a model instead of a network. It ships with a library of probes that try to make a model fail in known ways, then detectors that judge whether the attempt succeeded. You point it at a model, choose probes, and it runs them and reports what got through. It is freely available and a sensible starting point for anyone who wants a repeatable, automated first pass over a model’s weaknesses. The repository lives at github.com/NVIDIA/garak.

    Microsoft PyRIT

    PyRIT, the Python Risk Identification Tool for generative AI, is an open source framework from Microsoft built to help security professionals probe generative AI systems. Where a scanner runs a fixed battery, PyRIT is a framework you compose: it is designed to automate parts of the red teaming workflow and can adapt its approach across a multi turn exchange rather than firing a single static prompt. Microsoft has described it as something its own AI red team uses in practice. Treat it as a toolkit for building red teaming campaigns rather than a one click scanner. The repository is at github.com/microsoft/PyRIT.

    Promptfoo

    Promptfoo is an open source tool that started life as an LLM evaluation harness and grew red teaming and vulnerability scanning features. The evaluation heritage matters: it is built around declarative test configurations you can run locally and wire into a continuous integration pipeline, which makes it a natural fit for teams that want LLM security checks to run on every change rather than as a one off audit. Its red team mode generates adversarial test cases aimed at the kinds of weaknesses the OWASP LLM list catalogs. The project is at github.com/promptfoo/promptfoo.

    Giskard

    Giskard is an open source Python library for testing and evaluating machine learning models that has extended into LLM and agent testing. Its scanning approach generates test suites aimed at issues such as prompt injection, harmful content, and information disclosure, and it positions itself across both quality and security testing rather than security alone. Like the others here, treat the open source library as the verifiable core and read the current documentation for the exact probe coverage, since these projects iterate quickly. The repository is at github.com/Giskard-AI/giskard.

    Two notes on this whole category. First, several of these tools overlap in what they cover, so the question is rarely which one but which combination, and how it fits your workflow. Second, an evaluation harness and a security red teaming tool share a lot of plumbing, which is why so many of these projects do both. The line between testing whether a model is good and testing whether a model is safe is thinner than the marketing suggests.

    How llm security testing tools map to the real frameworks

    A tool is only as useful as the threat model it covers, and the frameworks are how you check coverage without taking a vendor’s word for it. Each side of this landscape has its own reference points.

    Frameworks for the LLM application side

    The anchor for testing LLM applications is the OWASP Top 10 for Large Language Model Applications. It enumerates the dominant risk classes for systems built on language models, including prompt injection, sensitive information disclosure, insecure output handling, and supply chain risks, and it is the closest thing the field has to a shared vocabulary. When a red teaming tool says it tests for OWASP LLM risks, this is the list it means, and you should ask which entries it actually exercises rather than accepting the logo. If you want a baseline before you shop, our free OWASP LLM Top 10 self assessment scorecard walks your own application through each entry so you know which risks you most need a tool to cover.

    The second reference is MITRE ATLAS, the Adversarial Threat Landscape for Artificial Intelligence Systems. Modeled on the familiar MITRE ATT&CK structure, ATLAS catalogs tactics and techniques that adversaries use against AI and machine learning systems, grounded in real world case studies. Where the OWASP list is a checklist of risk classes, ATLAS is a map of adversary behavior, which makes the two complementary. A serious LLM testing program uses OWASP to scope what to test and ATLAS to think like the attacker.

    Frameworks for the web testing side

    For meaning (a), where the model is doing the testing of conventional software, the governing reference is the OWASP Web Security Testing Guide, or WSTG. It is the long standing methodology for web application security testing, and it is the right yardstick for any AI driven scanner or autonomous agent that claims to test web applications. If a tool uses a language model to do web testing, the relevant question is how much of the WSTG methodology it actually covers, not how clever the model sounds. The framework existed before the AI layer and it still defines the job.

    The mapping is the honest way to compare tools across vendors. A tool that names the specific OWASP LLM entries or ATLAS techniques it covers is giving you something checkable. A tool that gestures at being comprehensive without mapping to anything is asking for trust it has not earned.

    How to evaluate an llm security testing tool

    Whichever meaning you are buying, the same small set of questions separates a useful tool from an expensive demo. None of them require you to trust the vendor’s framing.

    Does it prove findings or just flag them

    This is the single most important question, and it applies to both halves of the landscape. A tool that flags a possible vulnerability hands you a hypothesis you still have to verify. A tool that proves the finding, by exploiting it in a controlled way or by showing the exact adversarial input that broke a guardrail, hands you something actionable. The cost of the difference is false positive triage, which is where security teams quietly lose most of their time. Ask for the evidence a finding ships with, and weigh a tool that produces fewer, proven findings over one that produces a flood of maybes.

    Coverage of vulnerability classes

    Breadth is easy to claim and easy to check against a framework. For the LLM application side, ask which OWASP LLM Top 10 entries and which ATLAS techniques the tool actually exercises. For the web testing side, ask which parts of the WSTG it covers. A precise answer is a good sign. A tool that cannot map its coverage to any framework is telling you something.

    Autonomy versus human in the loop

    Decide how much independence you want before you shop, because it changes which category you are in. A copilot expects an expert beside it and is only as good as that person. An autonomous agent runs alone and must be judged on whether it can be trusted to stay in scope. Neither is better in the abstract. The wrong fit is buying autonomy you cannot supervise or buying a copilot when you needed scale.

    Scope and safety control

    Any tool that takes offensive action, especially an autonomous one, must give you hard control over what it touches. Look for explicit scope boundaries, the ability to stop a run, and non destructive testing modes. An agent that can chain an exploit is an agent that can cause damage if it wanders, so the controls around it are not a nice to have, they are the product.

    Reproducibility

    A finding you cannot reproduce is hard to fix and harder to verify as fixed. Favor tools that record exactly what they did, the inputs they used, and the path they took, so a result can be replayed. This matters doubly for LLM application testing, where model behavior can vary between runs, and a one time jailbreak that cannot be reproduced is difficult to prove or patch.

    Can the tool be turned against you

    This question is unique to the AI era and easy to forget. A tool that uses a language model to read untrusted content, a scanner ingesting a target’s responses, an agent reading a page, a copilot summarizing output, is itself exposed to prompt injection. Hostile text in the target can try to hijack the tool’s own model and steer its behavior. Ask how a tool isolates the untrusted content it reads from the instructions it follows. A testing tool that can be talked into misbehaving by its target is a liability, not an asset.

    A caveat worth keeping

    This space moves fast, and capabilities are easy to overstate. The tools named here are real and verifiable as of this writing, but specific features, coverage, and even ownership change quickly, so confirm the current state from each project’s own documentation rather than from any guide, including this one. Be especially wary of capability claims that lean on the mystique of a particular model rather than on reproducible evidence. The right posture is the one this whole field rewards: ask for proof, map claims to frameworks, and trust results you can reproduce over demos you cannot. A claim about an AI security tool deserves exactly the scrutiny you would apply to any other security claim.

    For the wider context on how AI is changing both offense and defense, see our broader guide on AI in security testing. On the building side, this category map reflects how we think about evidence backed testing at UnboundCompute, where the emphasis is on findings a tool can prove rather than findings it can only flag; you can read more on our about page. Whichever half of this landscape you are shopping in, the discipline is the same. Decide which problem you are solving, name the tools honestly, hold them to a framework, and believe the ones that show their work.

    Frequently asked questions

    What are llm security testing tools?

    The phrase covers two distinct categories. The first is tools that use large language models to perform security testing of ordinary software, which includes AI augmented scanners, LLM assisted manual testing copilots, and autonomous pentest agents. The second is tools that test the security of LLM applications themselves, meaning red teaming and guardrail tools that probe a model for prompt injection, jailbreaks, and data leakage. A buyer should decide which problem they are solving first, because the products are different. The risk classes on the application side are catalogued in the OWASP Top 10 for Large Language Model Applications.

    What tools red team LLM applications?

    Several open source projects are the verifiable anchors in this category. NVIDIA garak is an LLM vulnerability scanner that runs a library of probes against a model and judges what gets through. Microsoft PyRIT is a framework for composing red teaming campaigns that can adapt across a multi turn exchange. Promptfoo started as an evaluation harness and added red teaming and vulnerability scanning. Giskard is a testing library that extends into LLM and agent security. Read each project’s current documentation for exact coverage, since they iterate quickly. The garak repository is at github.com/NVIDIA/garak.

    Are autonomous AI pentest tools real?

    Yes, though capabilities are easy to overstate. XBOW describes itself as an autonomous offensive security platform that performs web application penetration tests and surfaces a finding only after confirming exploitability through a controlled, non destructive challenge. On the research side, PentestGPT is an open source project and academic study that structures a model’s reasoning into a tester like workflow; its own authors found language models handle discrete operations well but struggle to hold a coherent multi step strategy over a long engagement. The PentestGPT research was presented at USENIX Security 2024 and is documented at USENIX.

    How do you evaluate an llm security testing tool?

    Ask whether it proves findings with evidence or merely flags them, because false positive triage is where teams lose the most time. Check its coverage by asking which framework entries it actually exercises rather than accepting a broad claim. Decide whether you want an autonomous tool or a human in the loop copilot, and confirm there are hard scope and safety controls plus reproducible results. Finally, ask whether the tool itself can be turned against you through prompt injection of the untrusted content it reads. For the adversary behavior these tools should map to, see MITRE ATLAS.


    Looking for a tool that proves what it finds

    The hardest part of this whole category is the one this guide keeps returning to: separating a real, proven finding from a confident guess. UnboundCompute is an autonomous security researcher built around that exact constraint, reporting only the vulnerabilities it can confirm with evidence and holding back the ones it cannot. If that is what you want from your testing, you can request access.

  • AI Security Testing: A Vendor Neutral Guide to Where AI Helps and Where It Fails

    AI Security Testing: A Vendor Neutral Guide to Where AI Helps and Where It Fails

    AI security testing is the practice of using artificial intelligence, and large language models in particular, to find and prove security weaknesses in software, the way a human penetration tester would, but at a speed and breadth no human can match. An AI security testing system reads an application, reasons about how it could be abused, generates inputs to probe it, interprets what comes back, and tries to chain small flaws into a real attack path. The promise is straightforward: the part of offensive security that has always been bottlenecked on scarce expert time becomes something a machine can carry a large share of. The reality is more interesting and more honest than the marketing, because the same technology that makes an agent good at reasoning about attacks also makes it prone to confident guessing, and in security a confident guess that turns out wrong is not a harmless miss. This guide walks the whole space: what the term actually means, where AI genuinely helps, where it quietly fails, the categories of tools on the market, and how to evaluate one without being sold a flood of findings you cannot trust.

    Two different things people mean by ai security testing

    The phrase splits into two readings, and searchers mean both, so it is worth separating them before going further.

    The first reading is using AI to do security testing. Here AI is the tester. It drives scanners, writes payloads, reasons over an application’s logic, and in the most ambitious form runs as an autonomous agent that attacks a target end to end. This is the offensive, find the bug sense of the term, and it is the main subject of this guide.

    The second reading is testing the security of AI itself. Here the AI is the target. The work is red teaming a model or an LLM powered application to see whether it can be jailbroken, made to leak its system prompt, manipulated through prompt injection, or pushed into harmful output. This is a real and fast growing discipline with its own frameworks, and it is an adjacent category we cover below, because the moment you ship an application built on a model, its attack surface is something you have to test too.

    The two readings are not rivals. They increasingly meet in the middle: an autonomous testing agent is itself an AI system with an attack surface, so the tool doing the testing can become the thing that needs testing. Keep both in mind, but read most of what follows as being about the first sense unless the heading says otherwise.

    Where AI genuinely helps in security testing

    It is easy to be cynical about AI in security, and parts of this guide will earn that cynicism back. But there are places where the help is real and not hype. The common thread is that these are tasks involving reading a lot of context, reasoning over it in natural language, and producing structured output. That is exactly the shape language models are strong at.

    Reconnaissance and attack surface mapping

    Before anyone attacks anything, they have to understand what is there. Enumerating subdomains, endpoints, parameters, technologies, and trust boundaries is slow, tedious work that rewards patience over genius. AI is well suited to ingesting the raw output of recon tooling, correlating it, and summarizing an attack surface in a way a human can act on. It can read a sprawling API specification and point out which endpoints look authentication sensitive, or notice that a forgotten admin path showed up in a crawl. The judgement about what matters still belongs to a person, but the grind of assembling the map is something AI shortens considerably.

    Payload and fuzz input generation

    Generating test inputs is a creativity problem, and language models are good generators. Given a parameter and a hypothesis about how it is processed, a model can produce a wide and varied set of payloads to probe for injection, encoding confusion, or boundary errors, including odd cases a static wordlist would never contain. This is genuinely useful for fuzzing and for the trial and error of crafting an input that slips past a filter. The OWASP Web Security Testing Guide lays out the classes of weakness worth probing, and AI assisted generation is a natural fit for filling that test space faster than handwritten lists.

    Reasoning over application and business logic

    This is where AI moves past what a traditional scanner can do at all. Business logic flaws, an order of operations that lets you skip payment, a privilege check that trusts a value the client controls, a workflow that can be replayed, are invisible to pattern matching because they are not a known bad string. They are a violation of intended behavior, and understanding intended behavior requires reading the application like a person would. A model that can read code and request flows and reason about what should not be allowed can surface this class of bug, which is precisely the class that scanners have always missed.

    Triage and deduplication of scanner noise

    Anyone who has run a traditional scanner against a real application knows the output is mostly noise: hundreds of findings, many duplicated, many low severity, many outright false. Triaging that pile is itself a job. AI is good at clustering similar findings, collapsing duplicates, and drafting a first pass severity and likelihood for each, turning an unreadable report into a prioritized shortlist. It does not get the final say, but it makes the human reviewer’s first hour far more productive.

    Chaining several weaknesses into an attack path

    A single low severity finding is often shrugged off. The art of offensive security is seeing how three of them combine into a critical one. This reasoning over a chain, this information disclosure feeds that redirect which lands on the other endpoint, is exactly the multi step reasoning AI can attempt. An agent that holds the whole context can propose attack paths a checklist would never connect, which is one of the most valuable and most distinctly AI native contributions to the field.

    Drafting reproductions and reports

    A finding nobody can reproduce is a finding nobody will fix. Writing a clear reproduction, the exact request, the expected versus actual behavior, the impact, and a remediation, is real work, and it is writing work, which models do well. Used here, AI turns a terse note into a report a developer can act on, and it does it consistently across every finding rather than only the ones the tester had energy left to document.

    Where AI struggles, and the honest limits

    If the section above were the whole story, AI security testing would already be a solved product and this guide would be an advertisement. It is not, and the gap between the demo and the dependable tool lives entirely in this section. These limits are not temporary embarrassments to be marketed around. They are structural, and the better tools are built to respect them rather than to hide them.

    Hallucinated and unproven findings

    This is the central problem. A language model can produce a finding that reads as authoritative, with a plausible description, a severity, and a confident tone, that is simply not true. It inferred a vulnerability that the application does not actually have. In most uses of AI a hallucination is an annoyance you correct. In security testing it is poison, because an unproven finding consumes the scarcest resource on the defending side: the time of the engineer who has to investigate it. A tool that emits fifty findings where ten are real has not saved that engineer work; it has handed them forty dead ends to walk down first.

    An unverified security finding is not a weak signal, it is a tax on the one person whose time the tool was supposed to save.

    Nondeterminism and reproducibility

    The same agent given the same target can take a different path on two different runs and reach a different conclusion. That nondeterminism is fine for brainstorming and corrosive for testing, where the whole value of a result is that someone else can run it again and see the same thing. If a finding cannot be reliably reproduced, it cannot be trusted, prioritized, or verified as fixed. Reproducibility is not a nice property to bolt on later; it is most of what separates a security result from a security anecdote.

    Verification is genuinely hard for a model

    Generating a hypothesis about a vulnerability is the easy half. Proving it is true is the hard half, and it is the half models are weakest at. Real proof means actually executing the attack in a controlled way and observing the effect, not narrating that it would probably work. An LLM is fluent at the narration and unreliable at the rigor, which is why the difference between a tool that asserts a finding and one that demonstrates it with reproducible evidence is the single most important difference in this entire field. We return to this below, because it is the heart of the matter.

    Prompt injection against the testing agent itself

    An AI security testing agent reads attacker influenced content by design. It reads pages, responses, error messages, and fields, any of which a target can fill with text crafted to hijack the agent. This is prompt injection, listed as LLM01 in the OWASP Top 10 for Large Language Model Applications, turned around: a malicious target can plant instructions in its own responses to derail the tester, suppress real findings, or push the agent to act outside scope. The tool built to find attack surface has one of its own, and a serious offering has to defend the agent against the very inputs it exists to consume.

    Scope and safety control

    An autonomous agent that can attack is an agent that can attack the wrong thing. Without firm boundaries it may wander outside the agreed scope, hammer a production system, or take a destructive action that a careful human would have paused on. Real offensive testing carries real risk, and handing it to something that acts on its own raises the stakes on getting scope, rate limits, and stop conditions exactly right. Safety here is not a compliance checkbox; it is the difference between a test and an incident.

    The landscape: categories of AI security testing approaches

    The market is noisy and every vendor describes itself differently, but the approaches sort into a handful of honest categories. Knowing which one a tool belongs to tells you more about what to expect than any feature list.

    AI augmented SAST and DAST

    The most incremental category takes the established scanner models, static analysis of source code (SAST) and dynamic analysis of a running application (DAST), and adds a language model to reduce their worst flaw, which is false positives. The AI reviews each finding to suppress the obvious noise and to add explanation and remediation context. This is a sensible, low risk use that makes existing tooling more bearable. It does not, by itself, find the logic flaws that scanners structurally cannot see; it makes the scanner you already have less painful to read.

    LLM assisted manual testing copilots

    Here a human tester stays firmly in the driver’s seat and the AI rides along as a copilot, suggesting payloads, explaining unfamiliar technology, drafting reproductions, and proposing next steps. The early academic work in this shape, the PentestGPT research presented at USENIX Security 2024, showed that a model could reason usefully about attack paths while a person ran every command. This category keeps human judgement central and uses AI to make a skilled tester faster, which is the lowest risk way to get real value from the technology today.

    Autonomous pentest agents

    The most ambitious category removes the human from the per step loop. An autonomous agent is given a target and tool access, a browser, a terminal, custom modules, and it runs the attack end to end, deciding its own next move at each step. The clearest public proof that this can work at all is XBOW, an autonomous pentester that in 2025 reached the top of the HackerOne US leaderboard by reporting real vulnerabilities against live programs. This category is where the false positive, reproducibility, and scope problems above bite hardest, because there is no human checking each move, which is exactly why the proof and safety properties of a given agent matter so much. For the broader picture of automating the pentest itself, see our guide to automated penetration testing.

    AI red teaming tools for LLM applications

    This is the second reading of the term made into tooling: products that test the security of AI systems rather than using AI to test other things. They probe a model or an LLM application for jailbreaks, prompt injection, data leakage, and unsafe output. Open tools lead here, including NVIDIA’s garak, an LLM vulnerability scanner with a large library of probes, and Microsoft’s PyRIT, a red teaming orchestrator aimed at multi turn agentic attacks. If you ship anything built on a model, this category is not optional, and the attack surface it targets is the subject of our deeper look at the AI agent attack surface.

    Two of these categories deserve their own treatment, and we cover them in depth in the companion posts to this guide: a hands on survey of LLM security testing tools, and a wider look at the practice of AI in security testing across the workflow.

    How to evaluate an AI security testing tool

    Evaluating one of these tools is hard precisely because the impressive part, the fluent reasoning and the confident reports, is the part that is cheap to fake. The properties that actually matter are quieter and harder to demo. Here is what to hold a tool to.

    False positive rate, and whether it proves its findings

    This is the first and most important question, and it is two questions in one. What fraction of the findings are real, and does the tool back each one with evidence you can verify yourself, or does it merely assert it? A tool that demonstrates a vulnerability with a reproducible proof is in a different class from one that describes a vulnerability it believes exists. Ask to see the evidence behind a finding, not the description of it. If the answer is a confident paragraph rather than a reproduction, you are looking at a hypothesis engine, not a testing tool.

    Coverage and the vulnerability classes it handles

    Ask plainly which classes of weakness the tool actually finds. Injection and misconfiguration are the easy, well trodden ones. Business logic flaws and multi step attack chains are the hard, valuable ones that justify using AI at all. A tool that only re skins a scanner will quietly handle only the easy classes. Map its claimed coverage against a real framework like the OWASP Web Security Testing Guide so you are comparing against a known checklist rather than the vendor’s own list.

    Level of autonomy versus human in the loop

    Be clear eyed about where a tool sits on the spectrum from copilot to fully autonomous agent, because that position sets both its ceiling and its risk. More autonomy means more reach and less human friction, and also less human judgement catching a wrong turn. There is no single right answer; there is only a right answer for your risk tolerance, your scope, and the maturity of the tool. The mistake is letting a vendor blur where its product actually sits.

    Scope control and safety

    For anything autonomous, ask how scope is enforced, not merely declared. Can you bound exactly what it may touch? Can you set rate limits and stop conditions? What stops it taking a destructive action or wandering onto a system that was never in scope? A serious offensive tool treats these controls as core features, and frameworks like the NIST AI Risk Management Framework exist precisely to give this kind of governance a shared vocabulary. If safety is an afterthought in the pitch, it will be an afterthought in the product.

    Reproducibility and auditability

    Finally, can you reproduce a result and audit how it was reached? A finding you can rerun and a process you can inspect are what let you trust the tool over time, file the finding with confidence, and later verify it was actually fixed. Opaque output that cannot be reproduced or traced is a liability dressed as a feature, no matter how good it reads.

    The proof and false positive problem

    Every thread in this guide pulls toward one knot, so it is worth tying it off directly. The defining problem of AI security testing is not whether a model can find something interesting. It usually can. The problem is whether what it found is real, and whether you can prove it without spending the very expert time the tool was supposed to free up.

    A flood of unverified findings is worse than useless. It is actively harmful, because each false finding is a debt drawn against your security team’s attention, and attention is the resource you were trying to conserve. Ten unproven findings cost more than zero findings, because zero findings cost nothing to investigate and ten unproven ones cost ten investigations to clear. The naive AI tool optimizes for the impressive number on the report. The number is a liability if the team cannot trust it.

    This is why the strongest approaches invert the default. Instead of reporting everything the model suspects, they report only what the system can prove, by actually carrying out the attack in a controlled way and capturing reproducible evidence that it worked. A finding becomes a finding only after it has been demonstrated, not merely reasoned about. That discipline turns the false positive problem from a flaw you mitigate into a property the design refuses to allow. UnboundCompute is one example of this autonomous, proof grounded approach, where the agent reports a vulnerability only once it has reproduced it; it is named here as an illustration of the category, not as a recommendation, and the broader case for the discipline is laid out in our note on why we only report proven vulnerabilities. The principle stands whatever tool embodies it: proof first, evidence attached, or it does not count.

    Responsible use: what AI does not replace

    For all of this, AI does not replace the things that made security testing trustworthy in the first place, and pretending otherwise is how organizations get hurt.

    It does not replace skilled human judgement. Deciding what matters, sensing when a finding is wrong despite a confident report, and understanding a result in the context of a specific business are still human work. AI makes a skilled tester faster; it does not make an unskilled one safe, and a tool that lets someone with no security background point an autonomous agent at a system is a tool that lets them cause harm without understanding it.

    It does not replace authorization. Running offensive testing against a system you do not own or lack written permission to test is illegal, full stop, and an AI doing the testing for you changes none of that. Authorization is a human and legal precondition, and no degree of automation grants it.

    It does not replace scoping. Defining what is in bounds, what is off limits, and what counts as a destructive action a human must approve is judgement that has to be set before the agent runs, not discovered after. The threat models in MITRE ATLAS and the governance language of the NIST AI RMF both reinforce the same point: automation widens what a tool can reach, which makes deliberate, human owned scoping more important, not less.

    Where this leaves you

    AI security testing is real, and it is neither the panacea its loudest promoters claim nor the empty hype its skeptics dismiss. It genuinely shortens recon, generates better test inputs, reasons over logic that scanners cannot see, tames scanner noise, chains weaknesses into paths, and drafts the reports nobody enjoys writing. It genuinely struggles with hallucinated findings, nondeterminism, the hard work of proof, attacks aimed at the agent itself, and the discipline of staying in scope. The two readings of the term, using AI to test and testing AI, are both worth your attention, and increasingly they are the same problem viewed from two sides.

    The single idea worth carrying out of this guide is that in security, proof is the whole game. A finding you cannot reproduce is a rumor, and a tool that hands you rumors at scale has multiplied your work rather than divided it. So when you evaluate anything in this space, look past the fluent reports and the impressive counts and ask the one question that survives all the hype: can it prove what it found, and can you check the proof yourself? Anchor your evaluation in the public frameworks that already encode hard won judgement, the OWASP Top 10 for LLM Applications and Web Security Testing Guide, the NIST AI Risk Management Framework, and MITRE ATLAS, and let the tools earn their place against that standard rather than against their own pitch. Used that way, with a skilled human still holding the judgement and the authorization, AI becomes what it should be: a force multiplier for the tester, and never a substitute for the proof.

    Frequently asked questions

    What is AI security testing?

    AI security testing is the use of artificial intelligence, especially large language models, to find and prove security weaknesses in software the way a human penetration tester would, but faster and across more surface. It covers AI driven scanners, copilots that assist human testers, and autonomous agents that attack a target end to end. The term also extends to testing the security of AI systems themselves, such as red teaming a model for prompt injection. The OWASP Web Security Testing Guide describes the weakness classes such testing aims to cover.

    Can AI replace human penetration testers?

    No. AI shortens recon, generates payloads, reasons over logic, and drafts reports, but it does not replace skilled human judgement, authorization, or scoping. A language model can produce confident findings that are simply not true, and deciding what matters still requires a person. Frameworks like the NIST AI Risk Management Framework stress that automation widens what a tool can reach, which makes deliberate human governance more important, not less.

    Why are false positives such a big problem in AI security testing?

    Because an unverified finding costs the defending team real investigation time, which is the scarce resource the tool was meant to save. A flood of unproven findings is worse than useless, since each one is a debt drawn against an engineer’s attention. The strongest approaches report only vulnerabilities they can prove by actually reproducing the attack and attaching evidence. The OWASP Top 10 for LLM Applications also notes that models hallucinate, which is why proof matters more than volume.

    How do you test the security of an AI or LLM application?

    You red team it by probing for jailbreaks, prompt injection, data leakage, and unsafe output, treating the model as the target rather than the tester. Open tools lead here, including NVIDIA’s garak vulnerability scanner and Microsoft’s PyRIT orchestrator. Threat modeling can follow the techniques catalogued in MITRE ATLAS, which documents real adversary tactics against AI and machine learning systems.


    Putting AI security testing into practice

    This guide describes the approach UnboundCompute is built on: an autonomous security researcher that maps an application, proposes where to look, and reports only the vulnerabilities it can prove with reproducible evidence, so you get findings rather than a queue of maybes. If that is the standard you want for your own web apps and APIs, you can request access.

  • The GraphQL Attack Surface: Introspection, Query DoS, Broken Authorization, and Injection

    The GraphQL Attack Surface: Introspection, Query DoS, Broken Authorization, and Injection

    The graphql attack surface comes from a single design choice that makes GraphQL pleasant to build against: the client, not the server, decides the shape of the response. One endpoint at /graphql accepts a typed query, and the caller asks for exactly the fields it wants, as deeply nested as it likes, in whatever batch it cares to assemble. That flexibility is the whole appeal, and it is also the whole problem. A REST API exposes a fixed menu of routes, each returning a fixed payload. A GraphQL API hands the caller a programmable interface to your data graph and trusts them to use it gently. This post walks the specific ways that trust gets abused: how introspection turns the schema into a map, how nested and batched queries turn one HTTP request into thousands of resolver calls, how authorization slips through the gaps between resolvers, how injection still reaches the database, and how to put guards back on each of those.

    What makes the graphql attack surface different from REST

    Start with the model, because every issue below falls out of it. A REST API is a set of endpoints. GET /notes/42 returns a note, POST /notes creates one, and each route is a separate, individually secured thing. The server owns the response shape. If GET /notes/42 does not include the author’s email, the client cannot ask for it; the field simply is not on that route.

    GraphQL collapses all of that into one endpoint and one typed schema. Our invented app, Acme Notes, exposes everything through a single POST to /graphql. The client sends a query describing the exact shape it wants:

    query {
      note(id: 42) {
        title
        author {
          name
          email
        }
      }
    }

    Three things follow from this design, and each one widens the attack surface. First, there is a typed schema that names every type, every field, and every operation, and GraphQL can describe that schema to anyone who asks. Second, the client chooses the shape and depth of the response, so the server cannot reason about one fixed payload; it has to answer whatever query arrives. Third, the work is done by resolvers, one small function per field, each fetching its piece. The query above runs a resolver for note, then for author, then for name and email. The server stitches the result together. That resolver model is elegant and it is exactly where authorization tends to leak, because each resolver is its own little decision point.

    Introspection turns the schema into a map

    GraphQL ships with a reflection system. A special set of meta fields, chiefly __schema and __type, lets a client ask the server to describe itself: every type, every field, every argument, every deprecated operation, and the relationships between them. This is what powers the autocomplete in a GraphQL IDE and the documentation explorer. It is genuinely useful for developers, and it is a reconnaissance goldmine for an attacker.

    A single introspection query returns the full map. The canonical form walks __schema and pulls every type and field:

    query {
      __schema {
        queryType { name }
        mutationType { name }
        types {
          name
          fields(includeDeprecated: true) {
            name
            args { name type { name } }
          }
        }
      }
    }

    Run that against an unguarded endpoint and you learn the entire data model in one request. You see mutations that are not linked anywhere in the UI. You see deprecated fields that still resolve. You see internal types like AdminUser or BillingAccount that the front end never touches but the resolver still serves. There is no guessing at route names the way you would brute force a REST API. The server tells you everything, accurately, because describing itself is a feature.

    What makes this worse than a leaked REST documentation page is precision. Introspection is not a hint or a sample; it is the authoritative description the server uses to validate every query. The argument types it reports are the exact types it enforces. The deprecated fields it lists still resolve, because deprecation in GraphQL is a label, not a removal. An attacker who pulls the schema knows, before sending a single real query, which mutation creates an admin, which field exposes a token, and which argument is an unbounded string. Mapping a REST API is archaeology; mapping a GraphQL API is reading the blueprint the builder left on the table.

    Disabling introspection in production helps but does not fully close the door. Many GraphQL servers, Apollo among them, return field suggestions in error messages: ask for a field that does not exist and the server helpfully replies did you mean, leaking real field names one guess at a time. The tool clairvoyance, by Nikita Stupin, automates exactly this, recovering all or part of a schema from those suggestions even when __schema is turned off. On the testing side, InQL from Doyensec is a Burp Suite extension that parses introspection into ready to send query templates and detects circular references, and graphql-cop by Dolev Farhi is a small auditor that checks whether introspection, suggestions, batching, and depth limits are left open. These are accurate, real tools, and they make the reconnaissance step nearly free. The takeaway is that introspection is a default on convenience, and leaving it on in production means publishing your data model to anyone who points one of these utilities at /graphql.

    Denial of service through nested queries, batching, and aliases

    Because the client controls depth, it controls how much work the server does. The schema is a graph, and graphs have cycles. If a note has an author, and an author has notes, and each note has an author, you can write a query that descends through that relationship as far as you like:

    query {
      note(id: 42) {
        author {
          notes {
            author {
              notes {
                author { name }
              }
            }
          }
        }
      }
    }

    Keep nesting and the resolver count explodes. Each level multiplies the work, and a sufficiently deep circular query can force the server to fetch and join enormous amounts of data from a single small request. The attacker spends a few hundred bytes; the server spends seconds of database time and a heap of memory. This is a denial of service that needs no botnet, just one well shaped query.

    Batching and aliasing amplify it further. GraphQL lets you request the same field many times in one operation by giving each instance an alias. One HTTP request can therefore carry thousands of resolver calls:

    query {
      a: note(id: 1) { title }
      b: note(id: 2) { title }
      c: note(id: 3) { title }
      d: note(id: 4) { title }
    }

    Extend that to thousands of aliases and one request becomes a bulk operation. Many servers also accept an array of operations in a single POST, a separate batching feature with the same effect. Either way, the unit a naive rate limit counts, the HTTP request, no longer matches the unit of work, the resolver call.

    The fix is to stop reasoning about requests and start reasoning about cost. Query depth limiting rejects anything nested past a fixed level, which directly kills the circular query because a cycle has to nest to do damage. Complexity or cost analysis goes further: it assigns a weight to each field, sums the weight of the incoming query before executing it, and refuses queries over a budget. A list field that returns many items costs more than a scalar. A field whose resolver hits the database costs more than one served from memory. By scoring the query statically, the server can decline expensive shapes without ever running them, which is the only way to defend against a query you have not seen before. The OWASP GraphQL Cheat Sheet points at libraries like graphql-cost-analysis and graphql-validation-complexity for exactly this, alongside amount limits on list fields, server side timeouts as a backstop for anything that slips through, and a DataLoader to batch the resolver’s own database calls so legitimate nesting does not fan out into a query per node. The principle is to bound the work a single query is allowed to demand, regardless of how clever its shape is.

    Broken authorization at the field and object level

    This is where GraphQL hurts the most, and it follows directly from the resolver model. In a REST API the authorization check usually lives at the route: a middleware in front of GET /admin/users decides who gets in, and everything behind that one door is covered. In GraphQL there is no route to guard. There is one endpoint and a tree of resolvers, and each resolver is responsible for its own access control. Authorization is not enforced at the door; it is enforced at every field, and it only takes one unguarded field to leak.

    Picture Acme Notes. The note resolver carefully checks that the caller owns the note before returning it. Good. But a note has an author, and the author type exposes email and phone, and the resolver for author was written assuming you only ever reach it through your own notes. An attacker reaches it through a shared note, or through a different relation entirely, and now reads contact details for users they have no business seeing. The guarded object was the note; the unguarded one was reached by traversing a nested relation off it. That is broken object level authorization, the same class the OWASP API Security Top 10 ranks first as API1:2023, and the same bug the web calls IDOR. GraphQL makes it especially easy to introduce because the relationships that let a client walk from one object to another are the entire point of the data graph.

    In REST you guard the doors. In GraphQL there are no doors, only a graph, and every node has to guard itself. Miss one and an attacker walks in through a neighbor.

    There is a second flavor of this that introspection sets up directly. Because the schema lists every type and every argument, an attacker can call an object by its identifier even when the UI never offers it. Suppose Acme Notes hides delisted notes from every listing, but the note(id:) field still resolves any id it is given. The listing is a presentation choice; the resolver is the real access boundary, and if the resolver only checks that the id is well formed rather than that the caller owns it, the hidden object is one direct query away. The fix and the failure are the same as above: the check has to live in the resolver, on the object, not in the layer that decided what to show.

    The defense is per resolver authorization treated as a first class concern, not a sprinkle. Every resolver that returns sensitive data checks the caller’s right to that specific object, on both the nodes and the edges of the schema as the cheat sheet puts it. Centralizing this logic, rather than hand writing a check in each resolver, is what keeps one forgotten field from undoing the rest, and it is why teams move the decision into a shared authorization layer that every resolver consults rather than trusting each author to remember. If you want the broader pattern behind this bug, see our note on broken object level authorization and IDOR.

    Injection still reaches the database through resolver arguments

    GraphQL’s type system validates the shape of a query, not the safety of its values. A field that takes a String argument will reject a number, but it will happily pass an attacker controlled string straight through to whatever the resolver does next. If that resolver interpolates the argument into a database query, a shell command, or a NoSQL filter, you have the same injection you would have anywhere else, just arriving over GraphQL.

    Suppose Acme Notes has a search field:

    query {
      searchNotes(filter: "Marketing") {
        title
      }
    }

    If the searchNotes resolver builds its SQL by concatenating that filter string, an attacker sends a filter value crafted to break out of the string and the database executes it. The typed schema gave a false sense of safety here, because the type checked that filter is a string, not that the string is harmless. The fix is the ordinary one: parameterized queries and strict input validation inside the resolver, using GraphQL’s own scalars and enums to constrain arguments where you can, and never trusting an argument just because it passed type checking. The OWASP GraphQL Cheat Sheet is explicit that the type system is not an input validation layer.

    Batching attacks that bypass rate limits on sensitive mutations

    The aliasing trick from the denial of service section has a sharper edge when it is pointed at authentication. Rate limits on a login or a two factor check almost always count HTTP requests: five attempts a minute from this IP, then a lockout. Aliases let an attacker pack many attempts into one request, and if the limiter counts requests rather than operations, the limit never trips.

    mutation {
      a: login(user: "victim", code: "0000") { token }
      b: login(user: "victim", code: "0001") { token }
      c: login(user: "victim", code: "0002") { token }
      d: login(user: "victim", code: "0003") { token }
    }

    Stack thousands of those aliases and a single request brute forces a four digit two factor code, or sprays a password list against a login mutation, all under one entry in the rate limiter’s ledger. The same applies to coupon redemption, password reset codes, and any mutation whose protection assumed one guess per request. PortSwigger documents this alias based rate limit bypass in detail, and it is one of the first things a GraphQL specific scanner checks for.

    The defenses here are pointed. Count operations, not requests, so the limiter sees each aliased login as a separate attempt. Better yet, disable batching and aliasing on sensitive mutations entirely, or cap the number of aliases for a single field, so a login can appear once per request. The cheat sheet’s guidance is to prevent batching for sensitive objects like authentication and to enforce per object request rate limiting in code rather than only at the HTTP layer.

    The defenses, gathered in one place

    None of these issues is exotic, and the controls map cleanly onto them. Treat this as the checklist:

    • Restrict introspection in production. Disable __schema on public deployments, and turn off field suggestions too, since tools like clairvoyance rebuild the schema from suggestion errors alone. Keep introspection on only in environments you control.
    • Limit query depth and total cost. Reject queries nested past a fixed depth, and run cost analysis that weights each field and refuses anything over a budget before execution. Add amount limits on list fields and a server side timeout as backstops.
    • Use persisted queries or an allowlist. Register the exact queries your clients are allowed to send and reject everything else. An arbitrary query interface becomes a fixed, known set, which kills introspection, ad hoc nesting, and most batching abuse in one move.
    • Enforce authorization in every resolver. Check the caller’s right to each object on both nodes and edges, centralize the logic so it cannot be forgotten, and assume any field can be reached through a nested relation, not just through its obvious parent.
    • Validate arguments and parameterize. Never trust a value because it passed type checking. Parameterize database queries, validate inside the resolver, and constrain arguments with scalars and enums.
    • Disable batching where it bypasses rate limits. Count operations rather than requests, cap aliases per field, and turn off batching for authentication and other sensitive mutations.

    For the canonical references, anchor on the OWASP API Security Top 10, which frames the authorization and rate limiting risks; the OWASP GraphQL Cheat Sheet, which gives the concrete server side controls; and PortSwigger’s GraphQL API vulnerabilities material, which walks the attacks hands on. For tooling, graphql-cop, InQL, and clairvoyance are the real, current utilities worth knowing.

    The assumption that breaks

    Step back from the individual bugs and one assumption is holding all of them up. GraphQL hands the client control over the shape of the response, the depth it descends to, and the volume of work a single request demands, and it assumes the client is not hostile. Every issue in this post is that assumption failing. Introspection assumes you only want the schema to build against it, not to map it for an attack. Nesting assumes you ask for what you need, not for a circular query that melts the database. Aliasing assumes you batch for convenience, not to brute force a login under one rate limit entry. The resolver model assumes each field is reached through a friendly path, not traversed from an unexpected neighbor.

    That is what makes the graphql attack surface its own thing rather than REST with extra steps. The flexibility that makes GraphQL a good developer experience is precisely the flexibility an attacker uses, and the only durable fix is to bound what the client is allowed to ask for: restrict the schema’s visibility, cap the cost of a query, allowlist the operations, and check authorization at every node. The gap here is not a single broken function. It is the distance between what the server assumes a client will do and what a client can actually arrange, and that gap is the kind of thing you find by asking what each component trusts and why, rather than by scanning for a known bad string. It is exactly the kind of assumption an autonomous researcher built to test assumptions is meant to surface. Learn more about that approach on our about page.

    Frequently asked questions

    What makes the GraphQL attack surface different from a REST API?

    A REST API exposes fixed routes that each return a fixed payload, so the server owns the response shape. GraphQL exposes one endpoint and a typed schema, and the client chooses which fields it wants, how deeply nested, and in what batch. That flexibility means the server has to answer whatever query arrives, which opens introspection recon, query based denial of service, and field level authorization gaps. PortSwigger walks these attacks hands on in its GraphQL API vulnerabilities material.

    Why is GraphQL introspection a security concern?

    Introspection is a built in reflection system. A single query against __schema returns every type, field, argument, deprecated operation, and hidden mutation, handing an attacker a full map of your data model in one request. Disabling it in production helps, but servers that return field suggestions in errors still leak field names, and the tool clairvoyance rebuilds the schema from those suggestions alone. The OWASP GraphQL Cheat Sheet recommends disabling introspection and suggestions on public deployments.

    How do batching and aliasing bypass rate limits on a login mutation?

    Rate limits usually count HTTP requests, but GraphQL aliases let one request carry many copies of the same field. An attacker can pack thousands of aliased login or two factor attempts into a single request, and a limiter counting requests never trips. The fix is to count operations rather than requests, cap aliases per field, and disable batching for sensitive mutations. This maps to the rate limiting risks in the OWASP API Security Top 10.

    Why is broken authorization so common in GraphQL?

    GraphQL has no route to guard. There is one endpoint and a tree of resolvers, and each resolver enforces its own access control, so it only takes one unguarded field, often reached through a nested relation, to leak data. This is broken object level authorization, ranked first in the OWASP API Security Top 10 as API1:2023. The fix is per resolver checks on both nodes and edges, centralized so a single field cannot be forgotten.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • What Is a Padding Oracle Attack and How It Decrypts CBC Without the Key

    What Is a Padding Oracle Attack and How It Decrypts CBC Without the Key

    A padding oracle attack lets someone decrypt CBC encrypted data without ever knowing the key, using nothing but a single bit of feedback the system was never supposed to give away. The attacker submits a ciphertext, the system tries to decrypt it, and the system tells the sender one thing it should have kept to itself: whether the padding came out valid. That one bit, asked over and over against tweaked ciphertext, is enough to peel the plaintext apart one byte at a time, and even to forge ciphertext that decrypts to a message the attacker chose. The leak does not have to be an explicit error. A status code, a timing difference, or a connection that drops a hair faster is the same bit by another name. This post walks the mechanism from the ground up: how CBC chains its blocks, why messages get padded, where the oracle hides, the byte at a time math that turns it into a full decryption, and the real attacks that took this from a 2002 paper to a protocol wide emergency.

    What a padding oracle attack actually is

    A padding oracle attack is a chosen ciphertext attack against a block cipher running in CBC mode. The target is not the cipher itself. AES is not broken here, and neither is the key. The target is a small piece of behavior wrapped around the cipher: the part that, after decrypting, checks whether the padding bytes at the end of the message are well formed and reacts differently when they are not. An oracle, in the cryptographic sense, is any function an attacker can query that answers a yes or no question about a secret. Here the question is just is this padding valid, and the answer, leaked through any side channel at all, is the lever that pries the whole message open.

    To see how a yes or no about padding becomes a full decryption, you have to look at two pieces working together: how block ciphers pad messages, and how CBC mode chains its blocks. Neither is dangerous alone. The danger is in the seam between them.

    CBC mode and why padding exists

    A block cipher encrypts a fixed size chunk at a time. AES works on 16 byte blocks and nothing else. Feed it 16 bytes, get 16 bytes back. But real messages are not tidy multiples of 16. A session cookie might be 30 bytes, a form field 7 bytes. Something has to stretch the message out to a whole number of blocks before the cipher can touch it, and that something is padding.

    The most common scheme is PKCS#7. The rule is simple and self describing: figure out how many bytes you need to reach the next block boundary, call it N, and append N bytes each holding the value N. Need 4 bytes to fill the block, you append 04 04 04 04. Need 1 byte, you append a single 0x01. If the message already lands exactly on a boundary, you add a whole extra block of 16 16 16 ... 16 so that there is always padding to strip and the receiver is never guessing. On the way back out, the receiver reads the value of the final byte, say it is N, checks that the last N bytes all equal N, and lops them off. If those bytes do not form a valid pattern, the padding is wrong, and the receiver knows the message was malformed.

    That validity check is the seed of the whole problem. It is a test the receiver runs on attacker supplied bytes, and it has exactly two outcomes.

    How CBC chains the blocks

    CBC stands for cipher block chaining, and the chaining is the part that matters. You cannot just encrypt each block on its own, because identical plaintext blocks would produce identical ciphertext blocks and leak the structure of the message. CBC fixes this by mixing each plaintext block with the ciphertext of the block before it. If you are still building intuition for how plaintext, ciphertext, and XOR relate before tackling a modern mode like CBC, our free classical cipher solver lets you experiment with substitution ciphers and common encodings by hand, a learning aid for the basics rather than anything that touches the attack below.

    Encryption walks the blocks in order. Before a plaintext block P[i] is handed to the cipher, it is XORed with the previous ciphertext block C[i-1]. The very first block has no predecessor, so it is XORed with a random initialization vector, the IV, which travels alongside the ciphertext. In symbols:

    C[i] = AES_encrypt( P[i] XOR C[i-1] )
    P[i] = AES_decrypt( C[i] ) XOR C[i-1]

    The second line is where the attack lives, so it is worth slowing down. To recover a plaintext block on decryption, the receiver runs the ciphertext block C[i] through the cipher’s decrypt function, producing an intermediate value, and then XORs that intermediate value with the previous ciphertext block C[i-1]. Call the intermediate value I[i], so that I[i] = AES_decrypt( C[i] ) and the plaintext is simply P[i] = I[i] XOR C[i-1].

    Here is the crucial fact. The intermediate value I[i] depends only on C[i] and the key. It does not depend on C[i-1] at all. If the attacker changes the previous ciphertext block, the cipher still produces the exact same I[i], and the only thing that changes is the XOR applied to it afterward. The attacker controls C[i-1] completely, because it is just data in the ciphertext they are submitting. So the attacker holds one side of the final XOR in their hand. They are one unknown away from the plaintext, and that unknown is I[i].

    The leak: one bit that should never escape

    Put the two pieces together. The attacker takes a ciphertext block C[i] they want to decrypt, and they prepend a block of bytes they fully control, which the receiver will treat as the previous ciphertext block. The receiver decrypts C[i] to the fixed intermediate I[i], XORs it with the attacker’s chosen block to get some plaintext, and then checks the padding of that plaintext. Because the attacker is choosing the previous block byte by byte, they are choosing the output of that final XOR byte by byte, which means they are steering the plaintext the padding check sees.

    The receiver then does the one thing it must not do: it reveals whether the padding was valid. Maybe it returns a BAD_PADDING error distinct from a BAD_MAC error. Maybe both return the same error text but the padding failure comes back a few microseconds sooner because the code bails out before computing a MAC. Maybe a web app returns HTTP 500 on a decryption fault and HTTP 200 on a logic error further down. Any observable difference between valid and invalid padding is the oracle. The attacker does not need the plaintext spelled out. They need the system to answer one yes or no question about ciphertext they crafted, and answer it reliably.

    The cipher was never broken. The key never leaked. The system was simply willing to answer, thousands of times, a single question it believed was harmless: did this decrypt to something with valid padding?

    The byte at a time decryption

    Now the math. The goal is to recover the last byte of the intermediate value I[i], because once every byte of I[i] is known, the real plaintext falls out by XORing I[i] with the genuine previous ciphertext block. Knowing I[i] is knowing the plaintext.

    The attacker works on the last byte first. They take their controllable previous block, call it C', and they set its last byte to a guess value g, running g through all 256 possibilities from 0x00 to 0xFF. For each guess they submit C' followed by C[i] to the oracle and watch the answer. The decrypted last plaintext byte that the padding check sees is:

    P_last = I_last XOR g

    For almost every value of g the padding is invalid and the oracle says no. But there is a value of g for which the last plaintext byte comes out to 0x01, and a final byte of 0x01 is, by itself, valid PKCS#7 padding: it claims a single byte of padding whose value is one. When that happens the oracle says yes. At that moment the attacker knows:

    I_last XOR g = 0x01
    therefore  I_last = g XOR 0x01

    The last byte of the intermediate value is recovered with at most 256 queries, and no key was involved. There is one wrinkle worth naming: occasionally a yes is a false positive, where the byte before the last happened to make the plaintext end in 02 01 or similar, which is also valid. The attacker resolves it by perturbing the second to last byte of C' and re testing; if the padding still validates, the last byte really was forced to 0x01.

    Walking right to left across the block

    With I_last in hand, the attacker moves to the second to last byte, and the trick is to aim for padding of length two. They want the decrypted block to end in 02 02. They already know I_last, so they can set the last byte of C' to force the final plaintext byte to 0x02 exactly, using C'_last = I_last XOR 0x02. Then they brute force the second to last byte of C' through all 256 values until the oracle reports valid padding, which now means the block ends in the valid two byte pattern 02 02. That reveals the second to last byte of I[i] by the same XOR relation, I_second = g XOR 0x02.

    The pattern repeats leftward. To recover the byte at position k, the attacker fixes every already known byte to the right so the tail decrypts to the padding value k_pad repeated, then brute forces position k until the padding validates. Each byte costs at most 256 oracle queries, so a 16 byte block costs at most 16 times 256, roughly 4096 questions, to recover in full. Repeat per block and the entire message is decrypted. The whole thing runs on one fact: P[i] = AES_decrypt(C[i]) XOR C[i-1], with the attacker owning C[i-1] and the oracle confirming when the right side lands on valid padding.

    Notice what the attacker never needs. They never see the key, never run the cipher in the forward direction, and never have to guess more than 256 values at any step. The work is linear in the length of the message, not exponential, which is what separates this from brute force and makes it genuinely practical. Picture our invented app, Acme Notes, storing a session as an encrypted cookie and returning a clean error whenever a cookie fails to decrypt into well formed data. An attacker with a stolen cookie they cannot read, but can replay with edits, now has a live oracle: each tweaked cookie comes back valid or invalid, and a few thousand requests later the plaintext session, user id and all, is sitting in front of them. No alarm fires, because every individual request looks like an ordinary client sending a slightly malformed cookie.

    Turning the oracle into an encryption machine

    The same lever runs in reverse, which surprises people the first time they see it. Once the attacker can recover the intermediate value I[i] for any chosen ciphertext block C[i], they can forge ciphertext that decrypts to any plaintext they want. They pick a plaintext block P_target. They run the padding oracle against an arbitrary C[i] to learn its intermediate I[i]. Then they simply set the previous block to C[i-1] = I[i] XOR P_target, because AES_decrypt(C[i]) XOR C[i-1] = I[i] XOR (I[i] XOR P_target) = P_target. Chaining this construction block by block, working from the last block backward and choosing a fresh C[i] at each step, lets the attacker build an entire ciphertext that decrypts to a message of their choosing, all without the key. A pure decryption oracle has become a forgery tool. Vaudenay’s original paper laid out exactly this reversal.

    POODLE and Lucky Thirteen: the oracle in the wild

    This is not a chalkboard curiosity. Serge Vaudenay published the attack in 2002 in a paper titled Security Flaws Induced by CBC Padding, applying it to SSL, IPSEC, and WTLS. For years it was treated as a known issue with known mitigations. Then two attacks proved the mitigations were leakier than anyone wanted to admit.

    POODLE: CVE-2014-3566

    POODLE, disclosed in October 2014 and tracked as CVE-2014-3566, stands for Padding Oracle On Downgraded Legacy Encryption. The flaw lives in SSLv3, an obsolete protocol that almost everything still supported as a fallback. In SSLv3’s CBC mode, the padding bytes are not fully specified and not covered by the message authentication code. The receiver checks the length byte of the padding but does not verify the padding content, which is precisely the validity gap a padding oracle needs. A man in the middle who can force a connection to roll back from TLS to SSLv3, then make the victim resend the same secret over and over across fresh connections, can recover a chosen byte of ciphertext such as a session cookie in around 256 requests per byte. The downgrade is the clever part: even a client and server that both prefer modern TLS can be shoved back onto the vulnerable SSLv3, which is why the fix was not patching SSLv3 but ripping it out entirely.

    Lucky Thirteen: the timing variant

    Lucky Thirteen, disclosed in 2013 by Nadhem AlFardan and Kenneth Paterson and tracked as CVE-2013-0169, showed that you do not even need an explicit error to build the oracle. TLS implementations had been hardened so that bad padding and bad MAC returned the same error, closing the obvious leak. But the time taken to process a record still depended on the padding, because the amount of data fed into the MAC computation changed with how many bytes the code believed were padding. That tiny timing difference, measured carefully across many sessions, was itself the oracle. The name comes from the 13 byte TLS header that shaped the timing arithmetic. Lucky Thirteen made the point that a side channel does not have to be a message at all. A consistent difference in how long something takes is information, and information about padding validity is a padding oracle.

    It is worth placing this alongside its neighbors. A padding oracle is not insecure deserialization, where untrusted bytes become live objects, and it is not a network level fingerprinting trick. But all three share a shape: a component reveals more about how it processed input than it meant to, and an attacker turns that excess into leverage. Here the excess is a single bit about padding, and the leverage is total.

    The fix: authenticate before you decrypt

    The root cause is that the system makes a decision based on decrypted bytes before it has checked that those bytes are authentic. The padding check runs on ciphertext the attacker forged, and the result of that check escapes. Every fix is a variation on closing that ordering.

    The classic construction is encrypt then MAC. After encrypting the plaintext, you compute a message authentication code over the ciphertext, and you append it. On the way back in, you verify the MAC first, over the raw ciphertext, before you decrypt anything or look at any padding. If the MAC does not match, the ciphertext was tampered with, and you reject it immediately, having revealed nothing about padding because you never got that far. The attacker’s forged ciphertext fails the MAC check, the padding check never runs, and there is no oracle to query. The order is the whole point: the authentication has to gate the decryption, not the other way around.

    The modern answer folds both jobs into a single primitive: authenticated encryption, most commonly AES-GCM. An AEAD cipher encrypts and authenticates in one operation, so there is no separate padding check to leak and no separate MAC step to misorder. AES-GCM is also a stream style construction that needs no block padding at all, which removes the padding oracle’s target outright. The practical lesson the whole saga taught the field is short: do not compose your own encrypt and authenticate steps, and do not run a plain CBC cipher with a bolt on MAC unless you have proven the ordering and the constant time behavior. Reach for an AEAD mode and let it do both jobs together. The Vaudenay paper that started it all, and the Cryptopals CBC padding oracle challenge that lets you build one by hand, are both worth working through if you want the mechanism in your fingers rather than just your notes.

    The assumption that breaks

    Strip away the blocks and the XORs and one assumption is left holding the whole thing up. The system assumes that telling the sender whether the padding was valid is harmless. It feels harmless. Padding is plumbing, a formatting detail, the sort of thing you would happily log or return in an error so a developer can debug a malformed request. Surely a yes or no about formatting gives nothing away. But that single bit, asked enough times against ciphertext the attacker controls, is a decryption oracle and a forgery oracle at once. The harmless answer is the entire attack.

    The bug is not in AES and not in CBC. It is in a trust boundary drawn one step too late, where a check ran on unauthenticated bytes and its result was allowed to escape. That gap between what a system assumes it is safely revealing and what an attacker can actually reconstruct from it is the kind of flaw you find by asking, of every response a system gives, what does this answer tell someone who is asking it ten thousand times on purpose. It is exactly the kind of assumption an autonomous researcher built to test assumptions is meant to catch: not a known bad string to grep for, but a quiet belief that a side channel was too small to matter. Authenticate before you decrypt, reach for AES-GCM, and treat every difference a system can show, in errors, in status codes, in timing, as something an attacker is already measuring. Learn more about that approach on our about page.

    Frequently asked questions

    What is a padding oracle attack in simple terms?

    It is a way to decrypt CBC encrypted data without the key by abusing a system that reveals whether the padding of a decrypted message was valid. The attacker submits altered ciphertext, watches whether the padding check passes or fails, and uses that single yes or no answer to recover the plaintext one byte at a time. The cipher and the key stay intact; only the surrounding validity check leaks. Serge Vaudenay described the original attack in his 2002 paper Security Flaws Induced by CBC Padding.

    How does flipping bytes in the previous ciphertext block recover plaintext?

    In CBC mode the plaintext is P[i] = AES_decrypt(C[i]) XOR C[i-1], and the intermediate value AES_decrypt(C[i]) depends only on the key, not on the previous block. Because the attacker fully controls the previous block, they can brute force its last byte through all 256 values until the oracle reports valid padding, which forces the final plaintext byte to 0x01 and reveals the intermediate byte by XOR. Repeating right to left recovers the whole block. The Cryptopals CBC padding oracle challenge walks the math hands on.

    What was the POODLE vulnerability?

    POODLE, tracked as CVE-2014-3566 and disclosed in October 2014, stands for Padding Oracle On Downgraded Legacy Encryption. It exploits SSLv3, whose CBC padding is not covered by the message authentication code, giving an attacker a padding oracle. A man in the middle forces a connection to roll back from TLS to SSLv3, then recovers a chosen ciphertext byte such as a session cookie in around 256 requests. The fix was to disable SSLv3 entirely, as described in the Oracle POODLE advisory.

    How do you prevent a padding oracle attack?

    Authenticate before you decrypt. Use encrypt then MAC so the message authentication code is verified over the ciphertext before any padding is checked, which means forged ciphertext is rejected before the padding check ever runs. Better still, use an authenticated encryption mode such as AES-GCM, which combines encryption and authentication in one primitive and needs no block padding to leak. The timing variant Lucky Thirteen showed that even matching error messages leak through timing, so constant time processing matters too.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • How NTLM Relay Works and Why a Portable Authentication Breaks Active Directory

    How NTLM Relay Works and Why a Portable Authentication Breaks Active Directory

    An ntlm relay attack works because NTLM proves you know a password to one server but never ties that proof to the server you meant to reach. A machine authenticates to a host the attacker controls, and the attacker forwards that authentication, byte for byte, to a completely different server, where it lands as a valid login from the victim. Nothing is cracked. No password crosses the wire in either direction. The attacker is a relay sitting in the middle, taking an authentication that was meant for them and spending it somewhere it was never meant to go. This post walks the whole mechanism one step at a time: how the three message NTLM handshake actually works, why the proof it produces is portable to the wrong destination, how an attacker gets a victim to authenticate in the first place, where they relay it, and how each defense closes a different part of the gap.

    What an ntlm relay actually is

    NTLM is the older challenge response authentication protocol that Windows still falls back to across an Active Directory network, especially when a client reaches a server by IP address or by a name Kerberos cannot resolve to a service principal. It is a question and answer ritual. The server asks a hard question only someone who knows the password could answer, and the client answers it without ever stating the password. That property, no password on the wire, is genuinely good. The problem is everything the protocol forgets to check around it.

    The core flaw is a missing binding. When a client proves it knows a secret, that proof does not say which server it was meant for. It does not name the channel it traveled over. It is a free floating token of authentication that any server will accept as long as the math checks out. So a man in the middle who receives one valid authentication can carry it, unchanged, to a different server and be treated as the victim there. That relayed identity is the whole attack, and on a domain it routinely escalates from one captured login to full control of Active Directory.

    It helps to be precise about what this attack is not, because the name invites confusion. It is not a pass the hash attack, where the attacker already holds a stolen password hash and replays it. In a relay the attacker never possesses the hash at all; they only move a one time signed answer between two parties. It is not a brute force or a crack, because nothing offline happens to the response. And it is not a Kerberos attack, because Kerberos tickets are scoped to a named service and resist this kind of redirection by design. NTLM relay is its own thing: a live, in the moment forwarding of a genuine authentication to an unintended destination, exploiting a gap that lives in the protocol rather than in any one machine’s configuration.

    The NTLM handshake, message by message

    NTLM authenticates a client to a server in three messages. The Windows internals and most tooling call them Type 1, Type 2, and Type 3, but they map cleanly onto NEGOTIATE, CHALLENGE, and AUTHENTICATE. Picture a workstation in the Acme domain, acme.local, connecting to a file server.

    NEGOTIATE, the opening offer

    The client opens by sending a NEGOTIATE message. This is the Type 1 packet. It announces that the client wants to authenticate with NTLM and lists the options it supports, things like which NTLM version and which cryptographic flags it can handle. It carries no proof of identity yet. It is the client saying, here is how I would like to do this, what is your challenge.

    CHALLENGE, the hard question

    The server answers with a CHALLENGE message, the Type 2 packet. The important content is a randomly generated eight byte number called the server challenge. The server makes up a fresh random value every time and sends it down. The point of the randomness is that the answer to last time’s challenge is useless this time, which is meant to stop a simple replay of a recorded response. The server keeps a copy of the challenge it just sent so it can check the answer.

    AUTHENTICATE, the proof

    Now the client proves itself. It takes the server challenge and combines it with the cryptographic hash derived from the user’s password, which the client already holds, and with NTLMv2 it mixes in its own client challenge and a timestamp as well. It runs that combination through a keyed hash, HMAC-MD5 with the password derived key, and the output is the challenge response. That response goes back inside the AUTHENTICATE message, the Type 3 packet, alongside the username and domain.

    Here is the elegant part and the dangerous part at once. The password never travels. The client demonstrates that it holds the password hash by signing the server’s specific random challenge with it. The server, which can compute the same answer because it can ask a domain controller to validate the response against the stored hash, checks whether the client’s answer matches. If it does, the client has proven knowledge of the secret without ever transmitting the secret. Authentication succeeds.

    Why the proof is portable to the wrong server

    Walk back through what the client actually signed. It signed the server’s eight byte challenge. It did not sign the hostname it was connecting to. It did not sign the IP address, the service, or the network channel underneath. By default the AUTHENTICATE message contains a proof of password knowledge that is bound to a random number and to nothing else about the destination.

    So put an attacker in the middle. The victim machine starts authenticating to a server the attacker controls, call it the rogue endpoint. The attacker does not answer as a normal server. Instead the attacker opens its own NTLM connection to a real target server somewhere else on the network, a domain controller, say. The real target sends back its own CHALLENGE. The attacker takes that challenge and passes it straight back to the victim as if it were the rogue endpoint’s own challenge. The victim dutifully signs it with its password hash and returns the AUTHENTICATE message. The attacker forwards that AUTHENTICATE message, verbatim, to the real target. The target validates it, sees a correct answer to the exact challenge it issued, and grants the attacker a fully authenticated session in the victim’s name.

    The attacker never learns the password and never cracks a hash. They are a courier, carrying one server’s question to the victim and carrying the victim’s answer to a different server, and both ends believe they are talking to who they expected.

    This is why it is called a relay rather than a crack. The authentication is genuine. It is simply spent against a server the victim never intended to reach. Everything downstream is built on that single substitution.

    One detail matters for understanding the defenses later. The reason the substitution succeeds is that the victim’s signed response is computed over the challenge the attacker handed it, and that challenge is the real target’s challenge. The attacker is not generating challenges of their own; they are a conduit passing the target’s question through to the victim. That is what keeps the math consistent at the far end. It also explains why any defense that gives the victim a way to notice it is signing for the wrong server, or that ties the response to something the attacker cannot also forward, breaks the relay cleanly. The attacker controls the routing but not the content, and the content is where the cure lives.

    Step one for the attacker, getting an authentication to relay

    A relay needs an inbound authentication to forward. The attacker has two broad ways to make one appear: wait for it by poisoning name resolution, or force it by coercing a machine to authenticate on demand.

    Poisoning name resolution

    Windows networks are chatty and trusting about names. When a machine cannot resolve a name through DNS, it falls back to broadcast protocols that ask the whole local segment, who is this. LLMNR, NBT-NS, and mDNS are exactly that fallback. They are unauthenticated broadcasts, so any machine on the segment can answer. A user fat fingers a share name, or an application looks up a host that no longer exists, and the broadcast goes out asking the network to identify it.

    The tool Responder listens for those broadcasts and answers all of them, claiming to be whatever name was requested. The victim believes it found the host, connects, and begins authenticating with NTLM to the attacker’s machine. That is the inbound authentication the relay needs, harvested passively just by answering questions nobody was authorized to answer. The attacker does not have to provoke anything; on a busy network these mistyped names and stale lookups happen on their own throughout the day, and Responder simply scoops up whatever wanders by. The quality of the catch is a matter of patience and luck, which is why poisoning is often the opening move rather than the finishing one.

    Coercing authentication on demand

    Waiting is unreliable, so attackers prefer to compel a specific machine, ideally a high value one like a domain controller, to authenticate to them whenever they like. Several Windows protocols can be tricked into making an outbound authenticated connection to an attacker chosen host.

    The best known is PetitPotam, which abuses the Encrypting File System Remote Protocol, MS-EFSRPC. Discovered by Gilles Lionel, it is tracked as CVE-2021-36942, a Windows LSA spoofing vulnerability that Microsoft addressed in its August 2021 updates. An attacker calls an MS-EFSRPC method such as EfsRpcOpenFileRaw against a target and supplies an attacker controlled path. The target, including a domain controller, then reaches out and authenticates to that path over NTLM using its powerful machine account. The original PetitPotam variant could be triggered without authentication, which is what made it so sharp.

    It is one of a family. The PrinterBug, exploited by the SpoolSample technique, abuses the Print System Remote Protocol to make a machine’s spooler authenticate to an attacker host. PrivExchange abused a Microsoft Exchange feature to make the Exchange server authenticate with its highly privileged account. Different doors, same result: a chosen, often privileged machine account hands the attacker an NTLM authentication ready to relay.

    Step two, relaying it with ntlmrelayx

    Capturing the authentication is only half. The other half is forwarding it to a useful target before it expires, and the standard tool for that is ntlmrelayx, an example script in the Impacket toolkit. It is often paired with Responder or a coercion trigger: one component produces the inbound NTLM authentication, ntlmrelayx forwards it to a target server and then does something with the authenticated session. Where it points decides the outcome.

    Relay to LDAP, granting RBCD

    If the relay target is a domain controller’s LDAP service and the relayed identity has the rights, ntlmrelayx can write to Active Directory as the victim. A favored move is configuring resource based constrained delegation, RBCD. The attacker writes the msDS-AllowedToActOnBehalfOfOtherIdentity attribute on a victim computer object so that an account the attacker controls is allowed to impersonate any user to that computer. With RBCD in place the attacker can later request Kerberos tickets impersonating a domain admin to the victim machine and take it over. The relay grants the delegation; the delegation grants the takeover.

    Relay to SMB, reading and running

    Relayed to the SMB service on a target where the victim is a local administrator, the authenticated session lets the attacker act as an admin on that host: dump the local secrets, read the SAM, or execute commands. This is the classic relay outcome and the reason SMB signing exists.

    Relay to AD CS HTTP enrollment, the ESC8 path

    The most damaging target is Active Directory Certificate Services. Many AD CS deployments expose a web enrollment endpoint over plain HTTP that accepts NTLM authentication. The SpecterOps research that catalogued AD CS abuses, the paper titled Certified Pre-Owned, named this relay scenario ESC8. The attacker coerces a domain controller with PetitPotam, then relays the DC’s machine account authentication with ntlmrelayx to that AD CS web enrollment endpoint and requests a certificate for the domain controller. AD CS issues one. Now the attacker holds a certificate that authenticates as the domain controller. They use it to request a Kerberos ticket as the DC, and from there they can perform a directory replication and dump every credential in the domain. One coerced authentication becomes full domain compromise.

    What makes this chain so potent is how little the attacker needs to start it and how durable the prize is. The PetitPotam trigger could fire without any prior foothold in its original form, so an unauthenticated attacker on the network could begin the whole sequence. And a certificate is not a session that times out in minutes; it is a credential the attacker can hold and reuse for as long as it remains valid, surviving password resets of the account it impersonates. That combination, a low cost trigger feeding a long lived credential for the most privileged account in the domain, is why the PetitPotam to ESC8 path drew so much attention and so many emergency patches. It compresses the distance from outsider to domain owner into a handful of network calls, none of which involve guessing or cracking a single secret.

    That escalation from a single relayed login to total control is a textbook case of privilege escalation: each step trades a small foothold for a larger one until the attacker holds the keys to the whole directory.

    Defending against NTLM relay

    Each defense closes a specific part of the gap. None of them alone is the whole answer, which is why they are usually layered.

    Signing, so the relay cannot stay silent in the middle

    Message signing binds the authenticated session to a key both legitimate parties share, so a man in the middle who merely forwards packets cannot tamper with or sustain the session. SMB signing, when required rather than merely offered, defeats SMB relay. The equivalent for the directory is LDAP signing, which protects relayed LDAP connections. Requiring signing turns a relayed session into a session the relay cannot actually use.

    Channel binding and Extended Protection for Authentication

    Signing still leaves protocols that ride inside TLS, like LDAPS and the AD CS web endpoint. The fix there is channel binding, delivered as Extended Protection for Authentication, EPA. Channel binding ties the NTLM authentication to the specific TLS channel it was sent over. When the attacker relays the authentication to a target over a different TLS channel, the binding no longer matches and the target rejects it. That is precisely the protection that closes ESC8: enabling and requiring EPA on the Certificate Authority web enrollment and certificate enrollment web services makes the relayed authentication fail the channel check. LDAP channel binding does the same for LDAPS.

    Disabling NTLM and mitigating coercion

    The most thorough fix is to stop using NTLM at all and rely on Kerberos, which does bind tickets to the target service. Disabling NTLM where it is no longer needed removes the relayable authentication entirely, though it takes auditing to find every dependency first. Alongside that, blunt the coercion triggers: apply the patch for CVE-2021-36942 to mitigate PetitPotam, disable the Print Spooler service on domain controllers where it is not needed to shut the PrinterBug, and filter the RPC traffic the coercion protocols ride on. Removing the trigger means the attacker cannot summon an authentication to relay even where NTLM still exists.

    It is worth placing this attack against its neighbors. NTLM relay is a failure of authentication binding, not of authorization. The victim’s identity is genuine and the target’s permission check is working correctly; the flaw is that the genuine identity arrived at a server it never meant to authenticate to, a distinction the boundary between authentication and authorization makes precise. The relay corrupts the who, and the rightful permissions of that who do the rest.

    The assumption that breaks

    Strip away the tools and the protocols and one assumption is left holding the whole thing up. NTLM assumes that proving you know a secret to one server means you meant to authenticate to that server. The handshake is careful about the secret and careless about the destination. It binds the proof to a random challenge and to nothing about where the proof is headed, so the proof is portable. A man in the middle does not need to break the cryptography, defeat the hash, or learn the password. They only need to move a valid answer from the server that was meant to receive it to a server that was not, and the second server, checking only that the answer is mathematically correct, lets the victim in.

    The bug is not a weak cipher or a careless administrator. It is a missing link between an authentication and its intended target, an assumption that the proof and the destination are the same thing when in fact one travels and the other does not. That kind of flaw does not show up by scanning for a known bad signature. It shows up by asking what each component assumes about identity and why it still trusts a credential that arrived from somewhere it did not expect. That is the kind of question an autonomous researcher built to test assumptions is meant to ask. Require signing, bind authentication to its channel, retire NTLM where you can, and shut the coercion triggers that feed the relay. Learn more about that approach on our about page.

    Frequently asked questions

    What is an NTLM relay attack in plain terms?

    It is a man in the middle attack on Windows authentication. NTLM is a challenge response protocol where a client proves it knows a password by signing the server’s random challenge, without the password ever crossing the wire. The catch is that the signed proof is not bound to the server it was meant for, so an attacker who receives one authentication can forward it verbatim to a different server and be accepted as the victim there. The MS-NLMP specification documents the three message handshake the relay abuses.

    How does an attacker get a machine to authenticate to them?

    Two ways. Passively, the tool Responder answers broadcast name resolution requests over LLMNR, NBT-NS, and mDNS, so a victim looking for a host connects to the attacker and authenticates. Actively, the attacker coerces a chosen machine. PetitPotam abuses the MS-EFSRPC protocol to force a target, even a domain controller, to authenticate over NTLM, and it is tracked as CVE-2021-36942. The PrinterBug and PrivExchange achieve the same coercion through other protocols.

    What can an attacker do once the authentication is relayed?

    It depends on the target. Relayed to LDAP on a domain controller, the attacker can configure resource based constrained delegation to later impersonate an admin. Relayed to SMB where the victim is a local admin, they can run code or dump secrets. The most severe target is the AD CS web enrollment endpoint: the ESC8 attack documented in SpecterOps’ Certified Pre-Owned paper relays a coerced domain controller authentication to AD CS, obtains a certificate for the DC, and escalates to full domain compromise. The relay itself is usually performed with the ntlmrelayx tool.

    How do you defend against NTLM relay?

    Layer the controls. Require SMB signing and LDAP signing so a man in the middle cannot use the forwarded session. Enable Extended Protection for Authentication, which binds the authentication to its TLS channel and is what closes the AD CS ESC8 path. Disable NTLM where it is no longer needed so there is no relayable authentication, and apply the patch for PetitPotam plus disable the Print Spooler on domain controllers to remove the coercion triggers. The ntlmrelayx tool ships in the Impacket toolkit, which is useful for testing whether these defenses actually hold.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • What Is a Hash Flooding Attack and Why It Stalls a Server With Bytes

    What Is a Hash Flooding Attack and Why It Stalls a Server With Bytes

    A hash flooding attack is a low bandwidth denial of service that turns a data structure your server relies on against itself. A hash table promises constant time lookups, but that promise only holds when keys scatter evenly across buckets. If an attacker knows the hash function, they can craft hundreds of keys that all land in the same bucket, collapsing the table into a single long chain. Average case O(1) becomes worst case O(n) per operation, and building the table from n such keys costs O(n^2). A few hundred kilobytes of carefully chosen form fields or JSON keys, parsed automatically by the framework before any of your code runs, can pin a CPU core for seconds. This post walks the mechanism one step at a time: how a hash table actually stores keys, how an attacker engineers the collisions, why request parsing amplifies the damage, the 2011 wave that hit every major web platform at once, and the keyed hashing fix that closed the door.

    How a hash table earns its O(1) reputation

    A hash table is the workhorse behind every dictionary, map, and associative array you have ever used. The idea is simple. You have some keys, say the names of form fields, and you want to find the value for any key fast. Instead of scanning a list, the table keeps an array of buckets and runs each key through a hash function, a small piece of math that turns a string of bytes into a number. That number, taken modulo the number of buckets, tells the table which bucket the key belongs in.

    When two keys land in the same bucket, that is a collision, and it is normal. Real hash functions cannot map an unlimited set of strings to a fixed array without overlaps. The standard way to handle a collision is chaining: each bucket holds a small linked list, and colliding keys are appended to it. To look up a key, the table hashes it to find the bucket, then walks that bucket’s chain comparing keys until it finds a match.

    The reason this is fast is entirely about distribution. If a good hash function spreads n keys roughly evenly across n buckets, every chain is one or two entries long. Finding a key means hashing once and comparing once or twice, regardless of how many keys are in the table. That is the constant time, O(1), behavior everyone counts on. Inserting n keys one after another costs O(n) total, because each insert is O(1). The whole edifice of fast lookups rests on that even spread.

    The catch is that O(1) is an average, not a guarantee. It assumes the keys arriving at the table are not chosen by someone who wants them to collide. Drop that assumption and the same data structure behaves very differently.

    How a hash flooding attack engineers collisions on purpose

    Now suppose every key you insert hashes to the exact same bucket. The table never spreads anything. One chain grows longer with every insert while every other bucket sits empty. Looking up a key now means walking a chain of length n, comparing against every key already there. A single lookup is O(n) instead of O(1).

    Inserting is worse, because insertion has to check whether the key is already present before adding it. When you insert the kth colliding key, the table walks the existing chain of length k minus one to confirm the key is new. So the first insert does zero comparisons, the second does one, the third does two, and the nth does n minus one. The total work is 0 plus 1 plus 2 and so on up to n minus 1, which is n times n minus one over two. That is the quadratic blowup: building a table from n colliding keys costs on the order of n^2 comparisons rather than n.

    The math is what makes the attack so cheap for the attacker and so expensive for the server. Double the number of colliding keys and you quadruple the work. Ten thousand colliding keys is not ten thousand units of work, it is on the order of fifty million. A hundred thousand colliding keys is on the order of five billion comparisons, all to insert a payload that fits comfortably in a single request body. The attacker spends a few kilobytes of upload; the server spends seconds of one core grinding through a linked list.

    It helps to walk the asymmetry concretely. A parameter name like field0000 is about ten bytes on the wire. Ten thousand such names, separated by ampersands, is roughly a hundred kilobytes, a request body smaller than many images on a typical web page. An honest hundred kilobyte form with ten thousand distinct fields would insert into the table in about ten thousand operations, finishing in microseconds, because each key lands in its own bucket and the chains stay short. The same hundred kilobytes of colliding keys forces about fifty million comparisons, because every key has to be checked against the entire growing chain before it is added. The wire cost is identical. The CPU cost differs by a factor of five thousand. That ratio is the entire point of the attack: the work the server does is not proportional to the work the attacker does, and the gap between them widens with every key.

    The same quadratic curve also explains why the cap based mitigation discussed later actually works. The pain lives in the n^2 term, and n^2 is gentle for small n and brutal for large n. A thousand colliding keys is only about half a million comparisons, finished in a blink. Ten thousand is fifty million. A hundred thousand is five billion. Cutting the maximum n the parser will accept does not slow the attack by a constant factor, it moves you back down the steep part of the curve, where even adversarial input is cheap to process.

    Why knowing the hash function is the whole game

    None of this works if the attacker cannot predict where keys land. The collisions have to be engineered, and to engineer them you need to know the function. Many of the platforms hit in 2011 used a well known, fixed, non keyed hash. PHP arrays and a number of Java systems used Daniel Bernstein’s DJBX33A and DJBX33X functions, which are short, fast, and completely public. The function multiplies a running value by 33 and adds the next byte, so its behavior is easy to reason about and easy to reverse.

    With a fixed function and no secret, an attacker can compute, offline and ahead of time, large sets of distinct strings that all produce the same hash value. For DJBX33A there are well known short building blocks, pairs of two character strings that collide, and you can concatenate them to manufacture as many colliding keys as you like. The strings look like ordinary parameter names. There is nothing malformed about them. They simply happen to be chosen so the cheap public hash maps every one of them to the same number. The attacker does the hard combinatorial work once and reuses the result against every server running that function.

    The construction is worth understanding because it shows how little effort the attack takes once the function is known. Suppose you find two short strings, call them Aa and BB, that the hash maps to the same value. Because the hash processes a string one byte at a time, building the running value as it goes, any longer string built by gluing these blocks together in any order produces the same final value as long as the blocks are interchangeable at each position. Two interchangeable two byte blocks give you four colliding strings of four bytes, eight of six bytes, sixteen of eight bytes, and in general 2 to the power of the number of slots. A handful of base collisions, concatenated, yields an effectively unlimited supply of distinct keys that all hash to one bucket. The attacker never has to brute force the full set. They find a few small collisions and let concatenation multiply them. This is why the payload is cheap to generate and why every server running the same unseeded function is vulnerable to the same precomputed list.

    The request parsing amplifier

    An attacker still needs a way to get a server to insert thousands of attacker chosen keys into a hash table without writing any code on the server. Web frameworks hand them exactly that, for free, on every request.

    When a browser or a client sends a POST request with a form body or a JSON document, the framework parses it before your handler ever sees it. A body like a=1&b=2&c=3 is split on the ampersands and equals signs, and each name is inserted as a key into a dictionary so your code can read request.params["a"]. The same happens for JSON objects, for query string parameters, for multipart form fields, and in many stacks for HTTP headers and cookies. Parsing untrusted request data into a hash table is not an edge case. It is the single most common thing a web framework does, and it happens automatically, on the parsing path, with the keys taken verbatim from the request.

    That is the amplifier. The attacker does not need authentication, a vulnerable endpoint, or any application logic at all. They send one POST request whose body is nothing but colliding parameter names, a few hundred kilobytes of key1=&key2=&key3= where every key name is one of the precomputed collisions. The framework dutifully parses each one and inserts it into a single overloaded bucket, paying the quadratic cost on the way. One ordinary looking request, well under a megabyte, pins a core while the parser grinds. At demonstration bandwidth on the order of a slow home connection, a steady trickle of these requests was enough to keep a modern CPU core fully busy. The bandwidth to attack is trivial; the bandwidth to absorb the attack is the server’s entire core.

    The attacker never overwhelms the network or floods the server with volume. They send one small, well formed request and let the server’s own data structure do the expensive work, turning a few kilobytes of input into seconds of CPU.

    Consider our invented app, Acme Notes, which exposes a JSON API. A client posts a note as a JSON object, and the framework parses that object into a dictionary keyed by field name before validation. An attacker posts a single note whose JSON body has a hundred thousand keys, all engineered to collide. Acme Notes never gets to reject the note for being malformed, because the denial of service happens during parsing, inside the framework, before a line of Acme Notes code runs. The application looks blameless. The vulnerability lives one layer down, in the assumption that request keys are not adversarial.

    The 28C3 wave of 2011

    This stopped being theoretical at the end of 2011. At the 28th Chaos Communication Congress, Alexander Klink and Julian Walde presented Efficient Denial of Service Attacks on Web Application Platforms, and the impact was that it hit nearly every major web stack at the same time. PHP, Java based servers, Python, Ruby, and ASP.NET all parsed request parameters into hash tables built on predictable, non keyed hash functions. One technique, slightly retargeted per language, took them all down.

    The coordinated disclosure was tracked as oCERT-2011-003, which assigned a row of CVE identifiers across the affected platforms. PHP before 5.3.9 was CVE-2011-4885: it computed hash values for form parameters without restricting predictable collisions, letting a remote attacker burn CPU with many crafted parameters. Python was assigned CVE-2012-1150 under the same oCERT advisory. Ruby was CVE-2011-4815. On the Java side, Apache Tomcat was CVE-2011-4858, with sibling identifiers for Jetty, Glassfish, Geronimo, and the Rack middleware, among others. The point of the wave was not any single language. It was that an entire industry had independently reached for the same cheap public hash and the same automatic parameter parsing, and so shared the same flaw.

    It was not a new idea

    The class of attack was already eight years old in 2011. In 2003, Scott Crosby and Dan Wallach published Denial of Service via Algorithmic Complexity Attacks at the USENIX Security Symposium. They named the general category, algorithmic complexity attacks, where an attacker feeds an input crafted to drive a data structure or algorithm into its worst case rather than its average case. They demonstrated it against the hash tables in Perl and against the Bro intrusion detection system and the Squid proxy, knocking a Bro server over with less bandwidth than a dialup modem. They also pointed to the fix: universal hashing, where the hash function is parameterized by a secret the attacker does not know. The 2011 wave was the same attack the 2003 paper had described, finally cashed in against the web at scale.

    SipHash and the real fix

    The patches came in two flavors, and only one of them addresses the root cause.

    Capping the number of parameters

    The immediate, pragmatic mitigation was to limit how many parameters a request is allowed to carry. PHP’s fix for CVE-2011-4885 added a configuration directive, max_input_vars, defaulting to 1000, that caps the number of input variables parsed from a single request. If the quadratic cost only becomes painful past tens of thousands of keys, refusing to parse more than a thousand keeps any single request cheap. Other stacks added equivalent caps on parameter counts, header counts, and body sizes.

    This works, but it treats the symptom. The hash function is still predictable, so an attacker who finds any path that inserts more than the cap of attacker chosen keys, or any code that builds a large dictionary from untrusted input outside the parameter parser, can still trigger the blowup. A cap narrows the attack surface. It does not remove the property the attack depends on.

    Keyed hashing with SipHash

    The real fix is to make the hash function unpredictable, so the attacker can no longer compute colliding keys ahead of time. You introduce a secret key, chosen randomly at process startup, and mix it into the hash. The function still spreads keys evenly and runs fast, but its exact mapping is different in every process and unknown to anyone outside it. An attacker cannot precompute collisions for a function whose seed they cannot see. This is the universal hashing idea from the 2003 paper, made practical.

    The algorithm the ecosystem settled on is SipHash, a keyed hash function designed in 2012 by Jean Philippe Aumasson and Daniel Bernstein specifically in response to the hash flooding wave. SipHash is fast on the short strings that hash tables actually use as keys, and it takes a 128 bit secret key, so without that key you cannot find collisions. It was adopted as the keyed hash behind the default hash table implementations in Perl, Python, Ruby, and Rust, among others. Python exposed the seed through the PYTHONHASHSEED environment variable while it stabilized the change. Rust ships SipHash as the default hasher for its standard library hash map out of the box.

    The thing to hold onto is why a non keyed hash was the actual bug. A fixed public hash function is a contract the attacker can read. Once they know the function, the set of colliding keys is just a calculation, and the data structure has no defense because it cannot tell an adversarial key from an honest one. Adding a secret key changes the function from something public into something private, and the entire attack rests on the function being public. Cap the parameters if you like, but the function being predictable is the root, and a keyed hash is what pulls it out.

    If you want to see where this sits among related classes of bug, it shares DNA with the rest of the most common web vulnerabilities: a server trusting attacker controlled input to behave the way honest input does. Here the betrayed assumption is not about the content of a value but about the statistical shape of a set of keys. The closest relative is regular expression denial of service, where crafted input drives a backtracking regex into its worst case time instead of its average case, the same algorithmic complexity class seen from the regex engine; our free ReDoS regex analyzer checks a pattern for the runaway backtracking that makes that possible.

    The assumption that breaks

    Step back from the buckets and the chains and one assumption is holding the whole thing up. Every hash table assumes its keys are not chosen by an adversary who knows the hash function. That assumption is invisible in the textbook, where O(1) is stated as a fact rather than as an average over honest inputs. It is invisible in the framework, where parsing a request body into a dictionary looks like plumbing rather than a security boundary. And it was invisible across an entire industry that reached for the same fast public hash, until one conference talk made the cost visible everywhere at once.

    The bug was never a slow hash table or a careless parser. The bug was a data structure whose performance guarantee quietly depended on the goodwill of whoever supplied its keys, deployed on the one path where the keys come straight from an attacker. The fix was not to make the table faster. It was to remove the attacker’s ability to predict it, by making the function secret. That gap, between what a system assumes about its inputs and what an adversary can actually arrange, is the kind of flaw you find by asking what each component takes for granted and whether that thing can be chosen against it, rather than by scanning for a known bad string. It is exactly the kind of assumption an autonomous researcher built to test assumptions is meant to catch. Question the average case, key your hashes, and cap what you parse. Learn more about that approach on our about page.

    Frequently asked questions

    What is a hash flooding attack?

    It is a denial of service that abuses how hash tables store keys. A hash table gives O(1) average lookups only when keys spread across buckets. If an attacker knows the hash function, they can craft many keys that all collide into one bucket, so each operation degrades to O(n) and inserting n keys costs O(n^2). A small request of colliding keys then burns a CPU core. The class was first named by Scott Crosby and Dan Wallach in Denial of Service via Algorithmic Complexity Attacks at USENIX 2003.

    How does a small request cause so much load?

    Web frameworks parse request bodies, query strings, JSON keys, and headers into a hash table before your code runs. An attacker sends one POST request whose parameter names are all engineered to collide, often a few hundred kilobytes of key1=&key2= pairs. The framework inserts each name into a single overloaded bucket, paying the quadratic cost during parsing. The talk that demonstrated this across platforms was Efficient Denial of Service Attacks on Web Application Platforms at 28C3 in 2011.

    Which platforms were affected and what were the CVEs?

    The 2011 disclosure hit PHP, Java based servers, Python, Ruby, and ASP.NET at once, coordinated as oCERT-2011-003. PHP before 5.3.9 was CVE-2011-4885, Python was CVE-2012-1150, Ruby was CVE-2011-4815, and Apache Tomcat on the Java side was CVE-2011-4858, alongside identifiers for Jetty, Glassfish, Geronimo, and Rack. The shared cause was a predictable, non keyed hash function applied to attacker controlled request keys.

    How do you fix hash flooding?

    The real fix is keyed hashing: mix a secret seed chosen at startup into the hash so an attacker cannot precompute collisions. The ecosystem adopted SipHash, designed in 2012 by Jean Philippe Aumasson and Daniel Bernstein, as the default keyed hash in Perl, Python, Ruby, and Rust. Capping the number of parameters per request, such as PHP’s max_input_vars directive defaulting to 1000, helps as a mitigation, but a non keyed hash is the root problem because its collisions can be computed in advance.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • How Rowhammer Works: Flipping Bits in Memory You Were Never Allowed to Touch

    How Rowhammer Works: Flipping Bits in Memory You Were Never Allowed to Touch

    Rowhammer is a hardware level attack that flips bits in memory the attacker was never allowed to touch. It works because DRAM stores each bit as a tiny charge in a cell, the cells are packed extremely close together, and repeatedly activating one row of cells leaks charge into the physically adjacent rows. Do it fast enough, often enough, and a bit in a neighboring row changes from a one to a zero or back, with no read or write permission on that row required. The bug lives below the software stack entirely, in the silicon, which is what makes it so unsettling. This post walks the mechanism one step at a time: how a DRAM cell holds a bit, what the activate and precharge cycle is, why the disturbance appears, how an attacker turns a random flip into a broken security boundary, and what the later browser and mobile variants and the ECC and TRR defenses actually do.

    What rowhammer is, in one paragraph

    A DRAM chip is a grid of cells, each a capacitor that holds a charge and a transistor that gates access to it. Charge present means one logical value, charge absent means the other. The cells are organized into rows, and reading or writing any cell means activating the whole row it sits in. The discovery behind rowhammer, published by Yoonsung Kim and colleagues at ISCA 2014, is that hammering one row over and over, activating it thousands of times in a short window, disturbs the charge in the rows next to it enough to corrupt their stored bits. The attacker reads and writes only rows they are allowed to touch. The damage lands in a row they are not. That gap between what the attack accesses and what it corrupts is the whole story, and it is why the original paper is titled Flipping Bits in Memory Without Accessing Them.

    How a DRAM cell stores a bit

    Start at the bottom. A single DRAM cell is one capacitor and one transistor. The capacitor either holds a charge or it does not, and that presence or absence is the bit. The transistor is a switch that connects the capacitor to a wire called a bitline when you want to read or write it. Because a capacitor leaks charge over time, DRAM is dynamic: every cell has to be refreshed periodically, read out and written back, or the bit decays into noise. On commodity hardware that refresh happens on a fixed interval, traditionally every 64 milliseconds for the whole array.

    Cells do not stand alone. They are wired into a grid of rows and columns. All the cells in one row share a wire called a wordline, and all the cells in one column share a bitline. To touch any cell, the chip raises the voltage on that cell’s wordline, which switches on every transistor along the row at once and connects all of those capacitors to their bitlines. You cannot read a single cell in isolation. You read its entire row into a buffer, then pick the column you wanted.

    The activate and precharge cycle

    Getting at a row is a two step dance. First the memory controller issues an activate command for the row. That raises the wordline, dumps the row’s charges onto the bitlines, and latches the result into a strip of sense amplifiers called the row buffer. Now the row is open and its columns can be read or written quickly. When you are done with that row and want a different one in the same bank, the controller issues a precharge, which closes the open row, writes its contents back into the cells, and resets the bitlines to a neutral level so the next activate can begin cleanly.

    Every activate sends a voltage swing down a wordline that runs right past its neighbors. A single activate is harmless. The trouble is what happens when you force the same row through the activate and precharge cycle again and again, as fast as the chip allows, thousands of times before the next scheduled refresh comes around to repair the neighbors. That is the literal hammering in rowhammer.

    Why shrinking process nodes made the disturbance appear

    This was not a problem on older, larger memory. As DRAM makers shrank the process node to pack more capacity into the same die, the cells moved physically closer together and each capacitor got smaller, holding less charge to begin with. Closer cells mean stronger electrical coupling between a wordline and its neighbors, and smaller charge means a flip needs less disturbance to push a cell across its threshold. Past a certain density the repeated voltage activity on one row started leaking enough into adjacent rows to corrupt them before the periodic refresh could top them back up. The ISCA 2014 study tested modules from the three major vendors and found a large majority of recent DRAM modules vulnerable to these disturbance errors. The defect is not a manufacturing mistake in one batch. It is a consequence of how dense modern DRAM has to be, and it gets harder to avoid, not easier, as each generation packs the cells tighter.

    From a hammer to a bit flip: single sided and double sided

    Knowing that hammering corrupts neighbors, the next question is how to hammer effectively. Two refinements matter, and both come down to a detail of the activate cycle: a row only disturbs its neighbors while it is being opened and closed, so you have to keep forcing fresh activates rather than reading the same already open row.

    To guarantee that, an attacker accesses two different rows in the same bank in a tight loop and flushes them from the CPU cache between accesses, so each loop iteration forces a real activate down to the chip instead of being served from cache or the row buffer. This is single sided hammering: pick a couple of aggressor rows, pound them, and hope the disturbance lands on whatever victim row happens to sit beside one of them. The cache flush is the subtle part. Modern CPUs cache memory aggressively, so a naive loop that reads the same address repeatedly never reaches the DRAM at all; the second read onward is served from cache and the chip is never activated. Early proofs of concept used an explicit cache flush instruction, on x86 the clflush instruction, to evict the line after each access and guarantee the next read goes all the way down to the memory chip. Two aggressor rows in the same bank also help here, because alternating between them forces the row buffer to close one and open the other every time, which is exactly the activate and precharge churn that produces disturbance.

    Double sided hammering is sharper. A row has two immediate neighbors, the one above and the one below. If the attacker can hammer both of a victim row’s neighbors, the rows at position N minus one and N plus one, the victim row in the middle absorbs disturbance from both sides at once. Project Zero found this technique flipped vastly more bits and was necessary to get results on many of the machines they tested. Double sided hammering needs the attacker to know which physical rows are adjacent, which takes some reverse engineering of how addresses map to rows, but the payoff is a much higher flip rate on a chosen target.

    Weaponizing a flip: the page table entry attack

    A random bit flip somewhere in physical memory is, on its own, just a crash or a glitch. Turning it into a security boundary break is the hard and clever part, and the canonical demonstration is the 2015 Google Project Zero post Exploiting the DRAM rowhammer bug to gain kernel privileges, by Mark Seaborn and Thomas Dullien. They built two working exploits on real Linux machines.

    The first targets page table entries. On a modern system the operating system keeps page tables that map a process’s virtual addresses to physical memory, and each page table entry, a PTE, names a physical page and the permissions on it. The attack works like this. The exploit first sprays memory so it is filled almost entirely with the process’s own page tables, then hammers until it finds a flip that lands inside a PTE. If the flipped bit changes the physical page number that the PTE points at, there is a good chance the PTE now points at a page that is itself one of the attacker’s page tables. The moment that happens, the process has a writable mapping of its own page table. It can edit page table entries directly, point them at any physical page it likes, and from there it has read and write access to all of physical memory, including the kernel. That is full privilege escalation driven by a single well placed flip in a structure the attacker was never allowed to modify.

    The attacker never writes to the page table. The hardware changes it for them, one bit at a time, from a row next door.

    The second Project Zero exploit escapes the Native Client sandbox, NaCl, which was a way to run untrusted native code safely in the browser by validating that the code only used a restricted set of instruction sequences. The attack hammers the sandboxed code itself. NaCl enforces safe indirect jumps by masking the target address with a fixed instruction sequence, and a bit flip that changes a register number inside one of those sequences can turn a safe, validated jump into an unsafe one that lands on an unaligned address. From that misaligned landing the attacker reaches instruction bytes the validator never checked, including hidden syscall instructions, and breaks out of the sandbox. Two different boundaries, the kernel and the sandbox, both broken by the same physical effect.

    Browser and mobile variants

    The early proofs of concept needed special conditions, a native binary and often a cache flush instruction. The research that followed steadily stripped those requirements away, which is the part of the story that turned rowhammer from a lab curiosity into a broad concern.

    Rowhammer.js: from the browser, no native code

    Rowhammer.js, by Daniel Gruss and colleagues, showed that the attack could be triggered from plain JavaScript running in a browser, with no native binary and no special CPU instruction to flush the cache. The researchers built a memory access pattern that evicts cache lines using ordinary accesses alone, so that the hammering reaches DRAM even without a flush instruction available to scripts. That made rowhammer a remote concern: a flip could in principle be induced by visiting a web page, narrowing the gap between the hardware defect and an ordinary attacker.

    Drammer: deterministic flips on Android and ARM

    Drammer, from the VUSec group, carried the attack to mobile. It demonstrated rowhammer on ARM based Android phones and, importantly, made the exploit deterministic rather than probabilistic. It did this by abusing the phone’s memory allocator to land a page table in a physical location the attacker had already found to be flippable, so the flip reliably hit a useful target. Drammer was a root privilege escalation that relied on no software vulnerability at all, only the hardware bug, on a class of devices many people assumed were out of reach.

    One location hammering

    Later work showed that on some systems you do not even need two aggressor rows. One location hammering repeatedly activates a single row, relying on the memory controller’s row policy to keep closing and reopening it so each access becomes a fresh activate. It works where the controller uses a closed page or adaptive policy, and it further trimmed the conditions an attacker needs to satisfy.

    Defeating the defenses: ECC and TRR

    Two mitigations were widely treated as the answer to rowhammer. Research has shown both can be defeated, which is the honest state of the field, even though both still raise the bar.

    Error correcting code memory and ECCploit

    ECC memory adds redundant bits so the controller can detect and correct errors, typically correcting a single bit flip in a word and detecting two. The intuition was that rowhammer flips would simply be corrected away. ECCploit, from VUSec, showed this is not a clean defense. By using timing side channels to learn how the ECC scheme behaves and carefully arranging multiple flips in the same word, an attacker can engineer corruption that slips past correction. ECC raises the cost and the number of flips required, but it does not make a vulnerable module safe.

    Target Row Refresh, TRRespass, and Half-Double

    Target Row Refresh, TRR, is a defense built into DDR4 memory. The idea is that the chip watches for rows being activated unusually often and proactively refreshes their neighbors before a flip can develop, repairing the victim before the disturbance accumulates. It was marketed as the fix that closed rowhammer for good. It did not. TRRespass, from VUSec, showed that TRR implementations track only a limited number of aggressor rows at once, so an attacker who hammers many rows at the same time, a many sided pattern, can overwhelm the tracker and still flip bits on DDR4 modules that TRR was supposed to protect. Half-Double, demonstrated by Google, exploits a different gap: as cells shrink further the disturbance reaches beyond the immediate neighbor to rows two steps away, and the very act of TRR refreshing a near neighbor can itself contribute disturbance to a row further out. Both results say the same thing. The in chip mitigations narrowed the attack but did not end it.

    What actually helps

    No single mitigation closes rowhammer cleanly, so defense is layered. Increasing the refresh rate, refreshing the whole array more often than the standard interval, gives disturbance less time to accumulate before a victim row is repaired, at a cost in performance and power. ECC and TRR each raise the number of flips or the precision an attacker needs, even though neither is sufficient alone. The deeper fixes are in hardware: probabilistic or counter based schemes that track how often each row is activated and refresh threatened neighbors accurately, and successor memory standards that build stronger row activation tracking into the specification rather than leaving it to a vendor’s opaque, limited TRR logic. The direction of travel is to move the defense into the silicon where the bug lives, because nothing in software can stop a charge from leaking between two cells the manufacturer placed a few nanometers apart. There are also operating system and allocator level mitigations that try to keep security sensitive structures like page tables physically away from memory an attacker can hammer, which raises the difficulty of the targeting step even when the underlying flip is still possible.

    It is worth being precise about what is demonstrated versus theoretical. The bit flips themselves, the PTE and NaCl exploits, the JavaScript and Android variants, and the bypasses of ECC and TRR are all demonstrated on real hardware in published research. What any given attacker can do against a specific deployed machine depends heavily on the exact memory modules, the controller policy, and the mitigations in place, and reliable exploitation in the wild is harder than a lab proof of concept. The bug is real and the exploits are real; the difficulty is in the targeting.

    Rowhammer also sits near other low level boundary breaks. Once an attacker flips a PTE and gains arbitrary physical memory access, what follows is privilege escalation in the classic sense, climbing from an unprivileged process to kernel level control. The difference is where the leverage comes from. Here it does not come from a logic bug in code. It comes from the memory itself betraying the software running on top of it.

    The assumption that breaks

    Step back from the wordlines and the page tables and one assumption is holding everything up. Every piece of software running on a computer trusts that memory it did not write cannot change underneath it. A program reads back what it stored. The kernel assumes its page tables say what it set them to say. The whole edifice of memory protection, of one process being walled off from another, rests on the substrate being inert, a passive box that holds bits faithfully until something with permission changes them. Rowhammer is the discovery that the substrate is not inert. Charge leaks between cells that were supposed to be independent, and an attacker with no permission on a row can reach into it through the silicon and change what it holds. The boundary everyone drew at the permission check actually ran somewhere lower, in the physics of how the bits are stored, and that lower boundary was never enforced at all.

    The bug is not a coding mistake you can find by reading the source. It is an assumption baked so deep into the model of computing that almost nobody thought to question it, that the hardware keeps your bits the way you left them. That kind of flaw, the unstated premise that the layer below you is trustworthy, is exactly what you find by asking what each layer trusts and why, rather than by scanning for a known bad pattern. It is the kind of assumption an autonomous researcher built to test assumptions is meant to catch, the ones nobody wrote down because they seemed too obvious to fail. Learn more about that approach on our about page.

    Frequently asked questions

    What is rowhammer and how does it flip bits?

    Rowhammer is a hardware level defect in DRAM. Each bit is a charge in a tiny capacitor, the cells are packed very close together, and repeatedly activating one row leaks charge into the physically adjacent rows until a bit in those neighbors flips. The attacker reads and writes only rows they are allowed to touch, but the corruption lands in a row they are not. The seminal study by Kim and colleagues, Flipping Bits in Memory Without Accessing Them, first characterized this disturbance error across DRAM from all three major vendors.

    What is the difference between single sided and double sided hammering?

    Single sided hammering pounds a small set of aggressor rows and hopes the disturbance lands on whatever victim row sits beside one of them. Double sided hammering targets both immediate neighbors of a chosen victim, the rows at N minus one and N plus one, so the victim in the middle absorbs disturbance from both sides at once. Google Project Zero reported in Exploiting the DRAM rowhammer bug to gain kernel privileges that double sided hammering flipped vastly more bits and was necessary on many machines they tested.

    How does a random bit flip become a kernel privilege escalation?

    An attacker sprays memory with their own page tables, then hammers until a flip lands inside a page table entry and changes the physical page it points at. With luck the entry now maps one of the attacker’s own page tables as writable, giving them direct edit access to address translation and from there read and write access to all of physical memory, including the kernel. The full Project Zero writeup walks both this PTE attack and a Native Client sandbox escape.

    Do ECC and Target Row Refresh stop rowhammer?

    They raise the bar but neither is a clean fix. ECCploit showed that carefully arranged multiple flips in one word can slip past error correction, and TRRespass showed that Target Row Refresh tracks only a limited number of aggressor rows, so a many sided hammering pattern can overwhelm it and still flip bits on DDR4. The VUSec TRRespass project page documents how built in TRR defenses were bypassed on real modules from all three major vendors.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • How Bluetooth LE Pairing Breaks: KNOB, BLESA, Just Works, and Sniffed Keys

    How Bluetooth LE Pairing Breaks: KNOB, BLESA, Just Works, and Sniffed Keys

    Bluetooth LE pairing is the handshake where two devices agree on a secret key so the rest of their conversation can be encrypted. Done right, that key is fresh, strong, and tied to the two devices that actually meant to talk. Done wrong, the key is weak, unauthenticated, or trivially guessed, and a third radio in range can read everything or pretend to be one of the endpoints. The mechanism is small, it runs in milliseconds, and most users never see it. That is exactly why its failures are so quiet. This post walks the pairing flow one step at a time, then walks the real attacks that break it: an entropy downgrade that shrinks a key to a single byte, a spoofing trick that abuses reconnection, an association model that encrypts without authenticating, and a passive sniff that recovers the key offline.

    What bluetooth le pairing actually does

    When two Bluetooth Low Energy devices first meet, they have no shared secret. A smartphone and an Acme smart lock are radios shouting into the same crowded band, and anyone nearby can hear the same packets. Pairing is the procedure that turns that open exchange into a private channel. It does three jobs in sequence: the devices announce what input and output hardware they have, they pick an association model based on those capabilities, and they run that model to establish a key. Everything that follows, every encrypted read and write, rests on the key that pairing produced.

    There are two generations of this procedure, and the difference matters for every attack below.

    LE legacy pairing versus LE Secure Connections

    LE legacy pairing is the original mechanism, shipped with the first Low Energy specification. In legacy pairing the two devices first agree on a Temporary Key, or TK. They use the TK to derive a Short Term Key, the STK, which protects the rest of the exchange long enough to hand over a Long Term Key, the LTK, that gets stored and reused on later connections. The weakness baked into this design is the TK. Depending on the association model, the TK is either a six digit number the user typed, or it is simply zero. A small number space is a guessable number space, and that is the thread an attacker pulls.

    LE Secure Connections arrived in Bluetooth 4.2 and replaces the heart of the exchange with Elliptic Curve Diffie Hellman key agreement on the P-256 curve. Instead of agreeing on a tiny Temporary Key and stretching it, both sides contribute to a shared secret that an eavesdropper cannot reconstruct from the packets alone, because the private scalars never go over the air. The same four association models exist in both generations, but under Secure Connections they protect a real key agreement rather than a six digit guess. If you remember one defensive fact from this entire post, it is that requiring LE Secure Connections removes the foundation that the legacy attacks stand on.

    The four association models

    An association model is how the two devices authenticate the key they are agreeing on, given whatever buttons and screens they happen to have. The specification defines four, and which one runs is decided automatically from the input and output capabilities each side advertises.

    • Just Works is the model for devices with no screen and no keypad, which describes most cheap sensors, tags, and beacons. It runs the key agreement with no human in the loop and no value to compare. In legacy pairing the Temporary Key under Just Works is set to zero. It provides encryption, but it authenticates nothing.
    • Passkey Entry has one device display a six digit number and the user types it into the other, or the same number is keyed into both. That shared six digit value feeds the authentication, so a passive listener who never sees the digits cannot complete the handshake the same way.
    • Numeric Comparison, available only under LE Secure Connections, shows a six digit value on both screens and asks the user to confirm they match. Because the value is derived from both sides of an authenticated key agreement, confirming it rules out a radio sitting in the middle. This is the strongest model when both devices have a display.
    • Out of Band moves the authentication data over a different channel entirely, commonly NFC. If a strong secret travels over that side channel, the over the air handshake can be authenticated against it, and a remote attacker who only hears the Bluetooth radio has nothing to work with.

    The split that runs through all four is whether the model provides authentication, often called MITM protection, or only encryption. Just Works gives encryption with no authentication. The other three, used correctly, give both. An attacker reads that capability advertisement as a menu, and Just Works is the cheapest item on it.

    How the pairing breaks

    Four weaknesses, each attacking a different assumption in the flow above. The first downgrades the key. The second skips authentication on reconnect. The third never had authentication to begin with. The fourth recovers the key by listening.

    1. The KNOB attack: negotiating the key down to one byte

    The Key Negotiation of Bluetooth attack, KNOB, was published by Daniele Antonioli, Nils Ole Tippenhauer, and Kasper Rasmussen, and it targets a step most descriptions of pairing skip entirely: the negotiation of how long the encryption key will be. Before encryption starts on a Bluetooth BR/EDR link, the two devices agree on the entropy of the key, anywhere from 16 bytes down to a legacy minimum of 1 byte. The problem is that this entropy negotiation is itself unauthenticated. It happens before the strong key protects anything, and nothing signs or checks the proposed length.

    An attacker positioned between the two devices rewrites that negotiation in flight. When one side proposes 16 bytes, the attacker lowers the proposal to 1 byte before it reaches the other side, and does the same in reverse. Both devices believe they negotiated honestly and both accept a key with only 8 bits of entropy. That is 256 possible keys. The attacker brute forces it, decrypts the traffic, and injects valid ciphertext, all without either victim noticing, because the downgrade is invisible at the application layer.

    The devices agreed on a key. They never agreed on how hard that key would be to guess, and the one negotiation they trusted to set that was the one nobody was protecting.

    This is tracked as CVE-2019-9506, scored 8.1 High, and its official description is precise: the specification up to and including version 5.1 permits a sufficiently low encryption key length and does not prevent an attacker from influencing the key negotiation. The researchers tested more than 14 chips from Intel, Broadcom, Apple, and Qualcomm, and nearly all accepted 1 byte of entropy. The full method is documented on the KNOB attack project page. The fix the Bluetooth SIG shipped is a floor: their security notice on key negotiation recommends enforcing a minimum encryption key length of 7 octets so the downgrade has nowhere low to go.

    2. BLESA: spoofing a device on reconnect

    Pairing is the expensive first meeting. Reconnection is the cheap reunion. Once two devices have stored a Long Term Key, every later session is supposed to skip the full handshake and just resume encryption using that stored key. The Bluetooth Low Energy Spoofing Attack, BLESA, comes from researchers at Purdue’s PurSec Lab with EPFL, and it lives entirely in that reconnection step.

    The researchers analyzed the reconnection procedure as written in the specification and found that authentication on reconnect is effectively optional and, worse, poorly enforced by real stacks. When a previously paired device reappears, the client is supposed to insist the connection actually use the keys they share. Instead, several implementations would accept data from a peer that claims to be the known device without the peer proving it holds the Long Term Key. An attacker who has observed the earlier pairing can therefore impersonate the server, the Acme lock or a fitness sensor, and feed the client spoofed data on reconnect. The client trusts it because reconnection is the step everyone designed to be frictionless.

    The work won a Best Paper award at the USENIX Workshop on Offensive Technologies in 2020, and the paper estimates it could affect well over a billion devices. The reconnection assumption is the dangerous part: the whole point of storing an LTK was to avoid re proving identity, and skipping that re proof is exactly the hole. The full analysis is in the BLESA paper at USENIX WOOT 2020.

    3. Just Works: encryption with nobody on the other end verified

    Just Works is not a bug. It is a documented model that does precisely what its design says, which is to encrypt without authenticating. The trouble is what that combination means against an active attacker. Because no value is compared and no secret is shared out of band, there is nothing in the handshake that distinguishes the real Acme lock from a radio impersonating it. An attacker who is present during pairing can sit between the phone and the lock, pair with each side separately, and relay between them. Both ends get an encrypted channel. Both encrypted channels terminate at the attacker.

    This is the classic man in the middle, and Just Works is open to it by construction. The reason it is everywhere is hardware economics: a sensor with no screen and no keypad cannot run Passkey Entry or Numeric Comparison, so the capability negotiation falls through to Just Works as the only option both devices support. The defense is not to disable encryption but to refuse Just Works where it matters, by requiring the MITM protection flag during pairing so a device that can only offer Just Works is rejected for sensitive functions rather than silently accepted.

    It helps to be precise about what Just Works does and does not give you, because the marketing word is encryption and people stop reading there. The channel is encrypted, so a purely passive listener under LE Secure Connections cannot simply read the plaintext off the air. What is missing is any guarantee about who sits at the other end of that encrypted channel. Encryption answers the question is this traffic readable by an outsider. Authentication answers the question am I talking to the device I think I am. Just Works answers only the first, and an active attacker exploits the gap between the two by being the device you think you are. The phone encrypts faithfully to the attacker, and the attacker encrypts faithfully to the lock, and both sides see a green padlock the whole time.

    4. Passive sniffing of LE legacy pairing

    The first three attacks need an active radio in the conversation. The last one just listens. Mike Ryan’s tool crackle attacks LE legacy pairing offline, and it works because of the Temporary Key. Under Just Works the TK is zero. Under the six digit Passkey models the TK is a value in the range 0 to 999999, padded out to 128 bits, which sounds like a lot until you count it: one million possibilities is a number a laptop chews through in under a second.

    An attacker captures the legacy pairing exchange off the air, including the confirm values the two devices send. Then they compute the confirm value for every candidate TK and keep the one that matches what they captured. Recovering the TK unwinds the rest: the TK yields the Short Term Key, the STK protects the handover of the Long Term Key, and once the LTK is in hand the attacker decrypts the entire session and every future session that reuses it. No injection, no jamming, just a recording and a brute force. The technique is described in the crackle project on GitHub. The single line of defense is the generational one: LE Secure Connections replaces the guessable Temporary Key with a Diffie Hellman exchange that produces nothing for crackle to brute force.

    Why this lands hard on IoT

    These attacks would be academic if the affected devices were just headphones. They are not. Bluetooth Low Energy is the radio of choice for the cheapest, longest lived, least patched hardware in circulation, and that population maps almost exactly onto the weaknesses above.

    Smart locks are the sharpest example. A lock that uses Just Works, or that does not enforce authenticated reconnection, can be spoofed or relayed by an attacker in radio range, and the failure mode is a door that opens. Medical devices such as glucose monitors and insulin pumps carry data and sometimes control that a spoofing or eavesdropping attack turns into a safety problem, not just a privacy one. Wearables and fitness sensors leak a continuous stream of personal data over links that frequently fall back to Just Works because the band on your wrist has no keypad. And trackers, the small tags people attach to keys and bags, are designed to be silent and to reconnect automatically, which is precisely the reconnection behavior BLESA abuses.

    The common thread is constraint. These devices are too small for a screen, too cheap for careful firmware, and too long lived to be reliably updated, so they default to the weakest models and the oldest pairing generation. The economics that make them cheap are the same economics that make them vulnerable.

    There is a patching problem layered on top. When CVE-2019-9506 landed, the operating system vendors that ship general purpose devices, phones and laptops, pushed enforcement of a minimum key length fairly quickly. A standalone Acme lock or a budget fitness band has no such pipeline. Its firmware was flashed once at the factory and may never be touched again, and many such products have no mechanism to update the Bluetooth stack at all. So a weakness in the specification does not just affect devices for a patch cycle; it affects them for the entire service life of hardware that was never built to be fixed. An attacker does not need a fresh vulnerability against this population. The old ones never closed.

    Closing the gaps

    Every attack above has a corresponding control, and they stack. None of them requires inventing anything; they require refusing the weak defaults the specification still permits for compatibility.

    Require LE Secure Connections

    This is the single highest leverage change. Secure Connections mode replaces the legacy Temporary Key and STK chain with ECDH key agreement, which removes the guessable secret that crackle brute forces and strengthens the foundation under every association model. Devices can refuse to pair in legacy mode, and security sensitive products should. The legacy fallback exists for old peers; a lock or a medical device has no business honoring it.

    Enforce a minimum key length

    KNOB works because the entropy floor sits at 1 byte. Following the Bluetooth SIG guidance and enforcing a minimum encryption key length, 7 octets for BR/EDR, means an attacker who rewrites the negotiation cannot push it down to a brute forceable size. Platform vendors shipped exactly this enforcement after CVE-2019-9506, and devices should reject any negotiated key below the floor rather than accept whatever the negotiation lands on.

    Mandate authenticated reconnection

    BLESA exists because reconnection skipped the proof that the peer still holds the shared key. The fix is to make that proof mandatory: on every reconnect, require the link to actually use the stored Long Term Key and reject a peer that cannot demonstrate it. The convenience of a frictionless reunion is not worth accepting data from a device that never proved it is the one you paired with.

    Set the MITM protection flags

    During pairing, devices exchange authentication requirement flags, and one of them requests MITM protection. Setting it forces the capability negotiation toward an authenticated model, Passkey Entry, Numeric Comparison, or Out of Band, instead of letting it slide into Just Works. A device that can only offer Just Works then fails closed for sensitive operations rather than getting an unauthenticated channel by default. Pair this with Out of Band where you have a side channel like NFC, and the over the air handshake gets anchored to a secret the remote attacker never hears.

    These controls reinforce one another. Secure Connections kills the offline brute force, the key length floor kills the entropy downgrade, authenticated reconnection kills the spoof, and the MITM flag keeps the whole thing from quietly falling back to the model that authenticates nobody. The same discipline that protects a Bluetooth lock applies to the firmware underneath it; if the device boot chain is also worth trusting, the way the secure boot process verifies each stage is the embedded sibling of these radio side defenses.

    The assumption that breaks

    Strip the four attacks down and they share one root. Pairing assumes that the two devices negotiating the key are the only two in the conversation, and that the negotiation about the key is itself trustworthy. Both halves of that assumption fail. Just Works and weak reconnection break the first half, because a third radio can insert itself into a handshake that never proves who is on the other end. KNOB breaks the second half directly: the one negotiation that decides how strong the key will be is the one nobody bothered to authenticate, so an attacker edits it in transit and both victims sign off on a key they would never have chosen.

    The flaw is never a broken cipher. The ciphers are fine. The flaw is a step that was trusted without being checked, an entropy field nobody signed, a reconnection nobody re proved, a model that encrypts to whoever shows up. That gap between what a protocol assumes about its participants and what an attacker can actually arrange in the same radio band is the kind of weakness you find by asking what each step trusts and why it still trusts it, rather than by scanning for a known bad signature. It is exactly the kind of assumption an autonomous researcher built to test assumptions is meant to surface. Require Secure Connections, floor the key length, prove the peer on reconnect, and never let the handshake fall back to trusting a stranger. Learn more about that approach on our about page.

    Frequently asked questions

    What is the KNOB attack and what CVE tracks it?

    KNOB, the Key Negotiation of Bluetooth attack, lets a nearby attacker rewrite the encryption key length negotiation between two BR/EDR devices because that negotiation is unauthenticated, forcing a key with as little as 1 byte (8 bits) of entropy that is then trivially brute forced. It is tracked as CVE-2019-9506, scored 8.1 High, and the full method is documented on the KNOB attack project page.

    How does BLESA spoof a Bluetooth Low Energy device?

    BLESA, the Bluetooth Low Energy Spoofing Attack, abuses reconnection. After two devices pair and store a Long Term Key, later sessions resume without a full handshake, and the researchers found that authentication on reconnect is optional and poorly enforced in real stacks. An attacker can impersonate a previously paired device and feed spoofed data to the client. The analysis is in the BLESA paper from USENIX WOOT 2020.

    Why is the Just Works association model insecure?

    Just Works is the pairing model for devices with no screen or keypad, and it provides encryption without authentication. Because no value is compared and no secret travels out of band, nothing in the handshake distinguishes the real device from an impostor, so an attacker present during pairing can sit in the middle, pair with each side, and relay between them. The model is described in the Bluetooth SIG security overview.

    Can someone decrypt Bluetooth LE by just listening?

    Yes, against LE legacy pairing. Mike Ryan’s tool crackle recovers the Temporary Key, which is zero under Just Works or a value from 0 to 999999 under the six digit models, by brute forcing all candidates against captured confirm values in under a second. The recovered key unwinds the Short Term Key and then the Long Term Key, decrypting the whole session. The fix is LE Secure Connections. See the crackle project on GitHub.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.

  • What Is Sigreturn Oriented Programming and Why One Gadget Owns the CPU

    What Is Sigreturn Oriented Programming and Why One Gadget Owns the CPU

    Sigreturn oriented programming is a binary exploitation technique that turns one tiny piece of borrowed code into total control of the CPU. On Linux, when a signal is delivered, the kernel writes a snapshot of every register onto the user stack and trusts that snapshot completely when the handler returns. An attacker who can write to that stack forges the snapshot, triggers the return path, and the kernel obediently loads attacker chosen values into rax, rdi, rsp, rip, and the rest, all in a single step. Where a normal exploit hunts for a dozen scattered gadgets to set up one system call, this one needs almost nothing. This post walks the mechanism one step at a time: how a signal frame gets onto the stack, why the kernel never checks whether it is genuine, how a forged frame becomes a syscall chain that spawns a shell, and what actually stops it.

    What sigreturn oriented programming actually exploits

    The whole technique rests on one feature of how Unix systems deliver signals, and on one assumption the kernel makes about that feature. When a process receives a signal, the kernel does not just jump to the handler and forget where it was. It first saves the entire interrupted execution state so that, after the handler runs, the process can pick up exactly where it left off. That saved state is the signal frame, and it lives on the user stack, in memory the process can read and write like any other.

    The frame is not a vague summary of the process. It is a full register dump. On x86-64 Linux the saved context, a structure the kernel calls a ucontext wrapping a sigcontext, holds the values of the general purpose registers, the stack pointer, the instruction pointer, and the flags. Every register that defines what the CPU will do next is sitting there in plain memory, written by the kernel, waiting to be put back. The technique was first described in full by Erik Bosman and Herbert Bos of Vrije Universiteit Amsterdam in their 2014 paper, which named the saved frame as the entire attack surface.

    How signal delivery sets up the frame

    Walk the normal, benign path first so the abuse is obvious later. A process is running. A signal arrives, say SIGALRM or SIGSEGV. The kernel pauses the process, builds the signal frame on the user stack, and arranges for the registered handler to run. The handler does its work. When it returns, it does not return like an ordinary function. Instead, control flows to a small trampoline that invokes a special system call named rt_sigreturn.

    That syscall has exactly one job: take the signal frame currently on top of the stack and restore the process from it. The kernel reads the saved ucontext, copies every saved register back into the live CPU registers, restores the signal mask, and resumes execution at the saved instruction pointer. As the manual for sigreturn(2) puts it, the call restores the process context, meaning the processor flags and registers, including the stack pointer and the instruction pointer. After it runs, the process is bit for bit back where it was before the signal, and none the wiser.

    Here is the load bearing detail. The kernel does not keep its own private, trusted copy of that frame. It put the frame on the user stack, and when rt_sigreturn runs, it reads the frame back from the user stack. It does not check a cookie. It does not verify that a signal was ever actually delivered. It does not confirm that the bytes it is about to load are the same bytes it wrote. It reads whatever is at the top of the stack, interprets those bytes as a saved register set, and loads them into the CPU. The kernel assumes that a frame on the stack is one the kernel itself placed there. That assumption is the whole game.

    The forged frame

    Now suppose an attacker has a stack write, the classic precondition for any return oriented attack: a buffer overflow, a format string write, or any primitive that lets them lay out bytes on the stack and steer the return address. Instead of building a long chain of return addresses the way classic return oriented programming does, they write something simpler. They write a fake signal frame.

    The layout is fixed and public, so forging it is mechanical rather than clever. The attacker fills in the saved register slots with the exact values they want the CPU to hold: a chosen rip to control where execution goes, a chosen rsp to control the stack, a chosen rax to select a system call, and chosen argument registers rdi, rsi, and rdx to fill in that call’s parameters. They do not have to find a gadget that loads each register one at a time. They just write the value they want into the slot that the kernel will copy into that register. Tooling makes this trivial in practice. The pwntools exploitation library ships a SigreturnFrame class that builds the byte layout for you, so a practitioner writes frame.rdi = ... and frame.rip = ... rather than memorizing offsets.

    With the fake frame in place, the attacker needs only to make the program execute rt_sigreturn. On x86-64 that means getting the syscall number 15, which is 0xf, into rax and then reaching a syscall instruction. The kernel sees the syscall, treats the top of the stack as a genuine signal frame, and loads every forged register at once. One step, and the entire CPU state belongs to the attacker.

    The kernel does not ask whether the signal frame is real. It reads the stack, trusts the bytes, and loads them into every register the CPU has.

    Why one gadget is enough

    To appreciate why this technique matters, contrast it with the attack it descends from. Classic return oriented programming chains together short instruction sequences that already exist in the target binary, each ending in a ret, to assemble behavior the attacker wants without injecting any new code. To set up a single system call that way, you typically need a gadget to load rdi, another for rsi, another for rdx, another for rax, and then a syscall. If the binary is small or stripped down, some of those gadgets may simply not exist, and the whole approach stalls. Gadget availability is the limiting factor.

    Sigreturn oriented programming collapses all of that into one move. It does not load registers one at a time from scattered gadgets. It loads the entire register set in a single rt_sigreturn, sourced from a frame the attacker fully controls. That has three consequences that make it unusually strong.

    It is close to universal

    The rt_sigreturn path is part of the kernel’s signal machinery, not a quirk of any one program. The two ingredients the attacker needs, a way to set rax to 15 and a syscall instruction, are minimal and turn up almost everywhere. Bosman and Bos titled their paper around portability for this reason: an exploit built on signal frames travels across different binaries with little or no change, because it leans on a syscall convention rather than on whatever odd gadgets a particular binary happens to contain. Where classic chains are bespoke to each target, a sigreturn payload is close to write once.

    It barely cares about gadget scarcity

    Because the register values come from the forged frame rather than from gadgets, a binary that is too lean for a normal return oriented chain can still fall to this one. You are no longer searching the binary’s instruction stream for a way to control rsi. You wrote rsi directly into the frame. The attack sidesteps the exact scarcity that defeats classic chains, which is why it is so often the answer when a target offers almost nothing to work with.

    It hands you full register control

    Setting registers precisely is the hard part of many exploits, and here it is free. One rt_sigreturn sets all of them to known values in one shot, which makes the next step, invoking a system call with carefully chosen arguments, completely deterministic.

    Chaining syscalls into a shell

    The payoff of full register control is the ability to make any system call you like with any arguments you like. The canonical goal is a shell, which on x86-64 means calling execve("/bin/sh", NULL, NULL). The syscall number for execve is 59, which is 0x3b.

    The attacker forges a signal frame whose saved registers describe that call exactly. They set rax to 59 to select execve. They set rdi to the address of the string /bin/sh in memory. They set rsi and rdx to zero for the empty argument and environment pointers. Crucially, they set the saved rip to the address of a syscall instruction. When rt_sigreturn restores this frame, every one of those registers snaps into place and execution jumps straight to the syscall, which now runs execve with the attacker’s arguments. A shell pops.

    Often a single sigreturn is not the end but a stage. A common pattern when there is nowhere known to put the /bin/sh string, or no executable place to land, is to chain frames. The first forged frame calls a syscall like read or mmap to write attacker data into a known, writable, executable location, and it sets the saved rsp so that when that syscall returns, the stack is positioned at the next forged frame, which performs the next step. Each rt_sigreturn both performs a syscall and repositions the stack for the one after it, so a series of frames becomes a syscall chain that does setup work and then spawns the shell.

    This chaining is why the technique is so flexible in practice. The saved rsp in each frame is the thread that ties the stages together: it lets the attacker walk the stack pointer forward through a prepared sequence of frames without needing any gadget that adjusts the stack. A frame can call mprotect to make a writable region executable, then the next frame can jump into freshly written shellcode, then a final frame can clean up. The attacker is, in effect, scripting the kernel’s own restore path into a small virtual machine where each instruction is one forged frame and one syscall. That is a long way from the brittle, binary specific gadget hunting that classic chains demand.

    Where the syscall and the string come from

    The technique still needs two concrete addresses: somewhere to find a syscall instruction to put in the saved rip, and somewhere to find or place the /bin/sh string. This is where a known fixed location matters. Historically the vsyscall page on x86-64 Linux sat at the constant address 0xffffffffff600000 and was executable, which gave attackers a syscall gadget at a hardcoded spot regardless of address randomization. An mmap region created with a fixed address, or any leaked address that reveals where executable bytes and writable memory live, serves the same purpose. The sigreturn frame supplies the registers, but the attacker still has to point rip at real executable code, so a stable or leaked location is the other half of the recipe. This dependence on a known address is the same kind of memory layout problem you see in a kernel use after free, where control of where a stale object lives is what turns a dangling reference into a write primitive.

    How it relates to and differs from classic ROP

    It helps to be precise about the family relationship. Both classic return oriented programming and the sigreturn variant are code reuse attacks. Neither injects new executable code into the process, which is the point: they defeat the no execute protections that made plain shellcode on the stack stop working. Both rely on the attacker controlling the stack and the return address. So far they are siblings.

    The difference is where the register values come from. Classic chains source each register value from a separate gadget already present in the binary, then string those gadgets together with return addresses, so the chain’s power is bounded by what gadgets the binary contains. The sigreturn variant sources every register value from a single forged data structure that the kernel itself will faithfully load, so its power is bounded only by the attacker’s ability to write a frame and trigger one syscall. One is a sequence of borrowed instructions. The other is a single borrowed kernel mechanism that hands over the whole CPU at once. In CTF and real exploitation practice the two are routinely combined: a short classic chain sets rax to 15 and reaches a syscall, and that single act detonates the forged frame.

    Mitigations

    Because the flaw is an assumption rather than a memory bug, the defenses are a layered set rather than a single patch. None of them is a silver bullet, and one common belief about defense is simply wrong.

    Signal cookies, the direct fix

    The most targeted defense is the one Bosman and Bos proposed in the original paper: a signal cookie, sometimes called a sigreturn cookie. The idea is to make the kernel able to tell its own frames from forged ones. When the kernel writes a real signal frame, it also stores a random value derived from a secret combined with the address where the frame sits, in effect a canary bound to that stack location. On rt_sigreturn the kernel recomputes and checks that value before trusting the frame. An attacker who forges a frame cannot produce the right cookie without knowing the secret, so the forged frame is rejected. This directly attacks the trusted bytes problem at its root, and variants of this mitigation have appeared in some kernels. The elegance of the approach is that it changes the trust model rather than the layout: the kernel stops assuming that a frame on the stack is its own and starts proving it, which is exactly the assumption the attack abused.

    Vsyscall emulation and reduced fixed locations

    The old executable vsyscall page at its constant address was a gift to attackers, so modern kernels emulate it rather than letting code execute there directly. Since Linux 3.3 an attempt to run instructions in that page traps instead of executing, which removes one reliable, ASLR proof source of a syscall gadget. This does not stop the technique, but it removes a convenient fixed foothold and forces the attacker to find an executable address some other way.

    Control flow integrity and hardware shadow stacks

    Control flow integrity aims to ensure that indirect control transfers only land at intended targets, which constrains the return oriented building blocks the attacker stitches together. At the hardware level, Intel’s Control flow Enforcement Technology adds a shadow stack: a protected copy of return addresses that the CPU checks, so a corrupted return address on the normal stack no longer redirects execution unnoticed. These raise the cost of the surrounding chain that gets you to the syscall in the first place, though they target control flow hijacking broadly rather than the signal frame trust specifically.

    Full RELRO and hardening the rest of the path

    Defenses that close off the primitives an attacker uses to reach rt_sigreturn matter too. Full RELRO maps the global offset table read only after startup, removing a popular write target that exploits use to hijack control flow, which makes the initial stack write or redirect harder to obtain. Hardening the overflow or write primitive that the attack depends on shrinks the opening before signal frames ever enter the picture.

    The ASLR misconception

    It is tempting to assume address space layout randomization stops this. It does not, not on its own. Randomization hides where code and the stack live, which raises the bar, but the sigreturn technique only needs the attacker to write a frame to a stack they already control and to point rip at one executable address. Once any information leak gives up a single address, the layout is known and randomization is spent. Treat ASLR as one delaying layer that a leak cancels, not as a defense against forged signal frames. This is the same trap as treating a leak resistant looking design as safe: the moment one address escapes, the assumption underneath collapses.

    The assumption that breaks

    Strip away the frame layouts and the syscall numbers and one assumption is left holding everything up. The kernel assumes that a signal frame sitting on the user stack is one the kernel itself put there. The rt_sigreturn path was designed as the kernel’s private return road, a way to undo a context switch it had performed moments earlier, and it was built on the premise that only the kernel ever lays a frame down. So it reads the bytes and loads them into every register without a second look. The attacker never breaks that mechanism. They simply place a frame of their own on the stack and let the kernel do exactly what it was always going to do.

    The bug is not a corrupt syscall or a broken handler. The bug is a trust boundary drawn in the wrong place: the kernel trusted the contents of memory it had already handed to the process, and that memory is precisely what an attacker controls. That gap, between what a system assumes about who wrote some bytes and who actually can, is the kind of flaw you find by asking what each component trusts and why it still trusts it, rather than by scanning for a known bad pattern. It is exactly the kind of assumption an autonomous researcher built to test assumptions is meant to surface. Verify the frames you restore, narrow the fixed locations an attacker can lean on, and remember that a leak turns randomization back into a known address. Learn more about that approach on our about page.

    Frequently asked questions

    What makes sigreturn oriented programming so powerful?

    When a signal is delivered, the Linux kernel saves a full register snapshot, the signal frame, onto the user stack, and the rt_sigreturn syscall restores every register from it without checking that the frame is genuine. An attacker who controls the stack forges that frame and sets rax, rdi, rsp, and rip all at once with a single gadget, instead of hunting for one gadget per register the way classic chains do. The technique was introduced by Erik Bosman and Herbert Bos in Framing Signals: A Return to Portable Shellcode.

    How does SROP differ from classic ROP?

    Both are code reuse attacks that need a stack write and never inject new code, so they survive no execute protections. The difference is where register values come from. Classic return oriented programming sources each value from a separate gadget already in the binary, so it is limited by gadget availability. The sigreturn variant sources every value from one forged signal frame the kernel faithfully loads, so it works even on lean binaries. See the overview of sigreturn oriented programming for the comparison.

    How does a forged frame spawn a shell?

    The attacker builds a signal frame whose saved registers describe execve("/bin/sh", NULL, NULL): rax set to 59, rdi pointing at the /bin/sh string, rsi and rdx set to zero, and the saved rip aimed at a syscall instruction. Triggering rt_sigreturn with syscall number 15 loads the whole frame and runs the call. The SigreturnFrame helper in pwntools builds this byte layout automatically.

    Does ASLR stop sigreturn oriented programming?

    Not on its own. Address randomization hides where code and the stack live, but the attack only needs to write a frame to a stack the attacker already controls and to point rip at one executable address. A single information leak reveals that address and the layout is known. The real fix is a signal cookie that binds a secret to the frame’s stack location, the mitigation described in the sigreturn(2) manual and the original research, so the kernel can reject forged frames.


    Put an autonomous researcher on your own systems

    UnboundCompute is an autonomous security researcher that reasons about how an application fits together and proves the access control and injection bugs it finds. We are opening a small number of founding design partner seats: private early access pointed at a staging target you choose, a say in what it looks for, and founding pricing. If your team ships software worth pressure testing, apply to the design partner program.