AGENCYSCRIPT
CoursesEnterpriseBlog
đź‘‘FoundersSign inJoin Waitlist
AGENCYSCRIPT

Governed Certification Framework

The operating system for AI-enabled agency building. Certify judgment under constraint. Standards over scale. Governance over shortcuts.

Stay informed

Governance updates, certification insights, and industry standards.

Products

  • Platform
  • Certification
  • Launch Program
  • Vault
  • The Book

Certification

  • Foundation (AS-F)
  • Operator (AS-O)
  • Architect (AS-A)
  • Principal (AS-P)

Resources

  • Blog
  • Verify Credential
  • Enterprise
  • Partners
  • Pricing

Company

  • About
  • Contact
  • Careers
  • Press
© 2026 Agency Script, Inc.·
Privacy PolicyTerms of ServiceCertification AgreementSecurity

Standards over scale. Judgment over volume. Governance over shortcuts.

On This Page

The Categories of ToolingInput and output classifiersGuardrail and policy frameworksAgent and tool-security platformsObservability and red-team toolingSelection Criteria That MatterCoverage versus your actual riskLatency and cost per callTransparency and testabilityLock-in and exit costCommon Buying MistakesMistaking detection for protectionBuying for the demo, not the trafficStacking redundant layersBuy Versus BuildWhen to buyWhen to buildA simple decision ruleA staged adoption pathRunning a Real EvaluationTest against your traffic, not a benchmarkScore against your gaps, not its featuresWeigh exit cost before entryFrequently Asked QuestionsCan a single tool fully protect against prompt injection?Are open-source guardrail libraries good enough?How do I evaluate a tool's real effectiveness?Should small teams invest in tooling at all?Key Takeaways
Home/Blog/What to Buy, What to Build, and How to Tell the Difference
General

What to Buy, What to Build, and How to Tell the Difference

A

Agency Script Editorial

Editorial Team

·November 17, 2023·7 min read
prompt injection defenseprompt injection defense toolsprompt injection defense guideprompt engineering

The market for prompt injection defense tooling went from nonexistent to crowded in about eighteen months. Vendors now sell input classifiers, output guardrails, prompt firewalls, and full agent-security platforms, and every one of them promises to stop injection. Some genuinely help. Some solve a narrow slice of the problem and let you believe you bought a complete answer.

This survey is meant to give you a buyer's map: the categories of tooling that exist, what each is actually good for, the criteria that separate substance from marketing, and a way to decide what belongs in your stack versus what you should build yourself. The goal is not to crown a winner—your needs decide that—but to make you a sharper shopper.

Before evaluating any product, get clear on the structure of the problem using A Framework for Prompt Injection Defense, because a tool is only useful if it fills a stage you actually need filled.

The Categories of Tooling

Input and output classifiers

These models or services scan text for injection patterns before it reaches your main model, or scan completions before you act on them.

  • Strengths: Catch known attack patterns cheaply and add a measurable filtering layer.
  • Limits: Classifiers are probabilistic. They miss novel phrasings and produce false positives that frustrate users. They are a layer, not a wall.

Guardrail and policy frameworks

Libraries that let you declare rules—allowed topics, required output schemas, forbidden actions—and enforce them around model calls.

  • Strengths: Make enforcement explicit and testable; pin output format and tool usage.
  • Limits: Only as good as the policies you write. They give you a place to put rules, not the rules themselves.

Agent and tool-security platforms

Heavier systems that sit between your agent and its tools, enforcing least privilege, logging every call, and gating dangerous actions.

  • Strengths: Address the highest-leverage layer—limiting what a hijacked model can do.
  • Limits: More integration work and cost; can be overkill for read-only features.

Observability and red-team tooling

Logging pipelines and adversarial test suites that show you whether anything is getting through.

  • Strengths: Turn defense from a guess into a measurement. Indispensable for improvement over time.
  • Limits: They tell you about attacks; they do not stop them. Pair with enforcement.

Selection Criteria That Matter

Coverage versus your actual risk

Map each candidate tool to the defense stage it serves. A classifier helps with detection; a tool-security platform helps with containment. Buying three detection tools and zero containment tools leaves your worst risk—unauthorized actions—wide open.

Latency and cost per call

Every guardrail adds milliseconds and fractions of a cent. For a high-volume product that compounds. Measure the added latency on your real traffic, not the vendor's demo, and decide whether the protection justifies the tax.

Transparency and testability

Prefer tools you can probe with your own red-team suite. If you cannot measure a tool's block rate and false-positive rate on your data, you cannot trust its marketing numbers. The metrics to track are laid out in How to Measure Prompt Injection Defense: Metrics That Matter.

Lock-in and exit cost

Defense needs evolve fast. Favor tools with clean interfaces you can swap out. A guardrail layer wired deeply into your business logic is expensive to replace when something better appears.

Common Buying Mistakes

Mistaking detection for protection

The most frequent error is buying a classifier, watching it flag attacks in a demo, and concluding the problem is solved. Detection narrows the funnel but never closes it. A model that can still issue an unauthorized refund the moment a novel payload slips past the classifier is not protected; it is monitored. Treat any detection purchase as one layer that must sit on top of structural containment you own.

Buying for the demo, not the traffic

Vendor demos run on curated inputs at low volume. Your production traffic is messier and larger, and both the latency and false-positive characteristics of a tool change under that load. Insist on a trial against a representative slice of your real traffic before committing. A guardrail that adds 40 milliseconds in a demo can add far more at peak, and a false-positive rate that looks fine on clean inputs can frustrate thousands of real users.

Stacking redundant layers

More tools is not more safety past a point. Two classifiers that catch the same patterns double your cost and latency without meaningfully reducing risk, while leaving the containment gap untouched. Before adding a tool, name the specific defense stage it fills that nothing else covers. If you cannot, the money is better spent on owned enforcement.

Buy Versus Build

When to buy

Buy detection classifiers and observability—these are commodities where vendors have seen more attacks than you ever will, and rebuilding them wastes effort. Buy agent-security platforms when you run many agents with real tool access and need centralized policy.

When to build

Build the parts that encode your specific business rules: which tools exist, what counts as a dangerous action, and what your trust boundary is. No vendor knows your domain. Thin, owned enforcement around bought detection is a common, healthy split.

A simple decision rule

If a control is generic across companies, buy it. If it encodes your domain or your trust model, build it. When in doubt, buy detection and observability, build enforcement. For the broader set of trade-offs behind these calls, see Prompt Injection Defense: Trade-offs, Options, and How to Decide.

A staged adoption path

You do not need the full stack on day one. A sensible sequence is to start by building the cheapest, highest-leverage controls yourself—least-privilege tool access and action gating—because they cap your worst risk and require no vendor. Add bought observability next so you can see what is happening. Layer in a detection classifier once volume justifies it, and reserve an agent-security platform for when you operate several agents with real tool access and need centralized, auditable policy.

This ordering means your spend tracks your actual exposure rather than your anxiety. Each purchase closes a gap you have already confirmed exists, and you avoid the common trap of paying for a sophisticated platform before you have done the unglamorous structural work that platform assumes you already have in place.

Running a Real Evaluation

Once you have shortlisted candidates, the evaluation itself determines whether you choose well. A disciplined trial beats a feature comparison every time.

Test against your traffic, not a benchmark

Route a representative slice of your real inputs through each tool and measure block rate, false-positive rate, latency, and cost on that data. Benchmarks published by vendors are tuned to flatter; your traffic is the only fair judge. Budget enough volume in the trial to surface the messy edge cases that demos never show.

Score against your gaps, not its features

A tool packed with features you do not need is worse than a focused one that closes your actual gap. Score each candidate against the specific defense stage you set out to fill, and ignore capabilities outside that stage. The best tool is the one that fits cleanly into your stack and leaves the rest of it undisturbed.

Weigh exit cost before entry

Defense needs change fast, so factor in how hard each tool would be to remove. Favor clean interfaces and shallow integration over deep coupling to your business logic. A tool you can swap in an afternoon is worth more than a slightly better one that takes a quarter to extract when something superior appears.

Frequently Asked Questions

Can a single tool fully protect against prompt injection?

No. The problem spans multiple layers—separation, enforcement, auditing, and containment—and no single product covers all of them well. Any vendor claiming complete protection is selling one layer as if it were the whole stack. Build defense from complementary tools and your own enforcement.

Are open-source guardrail libraries good enough?

For many teams, yes, especially for output schema enforcement and basic policy. They give you a tested place to put rules without licensing cost. The rules themselves are still your responsibility, and you will likely supplement them with bought detection for novel attacks at scale.

How do I evaluate a tool's real effectiveness?

Run your own red-team prompt suite through it and measure block rate and false-positive rate on your traffic. Ignore vendor benchmark numbers in isolation—they are tuned to favorable conditions. A tool that cannot be tested transparently on your data should be treated with suspicion.

Should small teams invest in tooling at all?

Yes, but selectively. A small team should buy cheap detection and observability and build minimal owned enforcement around least-privilege tool access. The expensive agent-security platforms can wait until you have multiple agents with real action capability.

Key Takeaways

  • The tooling landscape splits into classifiers, guardrail frameworks, agent-security platforms, and observability.
  • No single tool covers every defense layer; complete protection claims are marketing.
  • Map each candidate to a defense stage and buy against your actual worst risk, not the flashiest feature.
  • Buy generic controls like detection and observability; build the enforcement that encodes your domain.
  • Insist on tools you can test with your own red-team suite and swap out cheaply.

Search Articles

Categories

OperationsSalesDeliveryGovernance

Popular Tags

prompt engineeringai fundamentalsai toolsthe difference between AIMLagency operationsagency growthenterprise sales

Share Article

A

Agency Script Editorial

Editorial Team

The Agency Script editorial team delivers operational insights on AI delivery, certification, and governance for modern agency operators.

Related Articles

General

Rolling Out AI Hallucinations Across a Team

Most teams discover AI hallucinations the hard way — a confident-sounding wrong answer makes it into a client deliverable, a legal brief, or a published report. The damage isn't just to the output; it

A
Agency Script Editorial
June 1, 2026·11 min read
General

Case Study: Large Language Models in Practice

Most teams that fail with large language models don't fail because the technology doesn't work. They fail because they treat deployment as a one-time event rather than a discipline — pick a model, wri

A
Agency Script Editorial
June 1, 2026·11 min read
General

Thirty-Second Wins Breed False Confidence With LLMs

Working with large language models is deceptively easy to start and surprisingly hard to do well. You can get a useful output in thirty seconds, which creates a false confidence that compounds over ti

A
Agency Script Editorial
June 1, 2026·10 min read

Ready to certify your AI capability?

Join the professionals building governed, repeatable AI delivery systems.

Explore Certification