c0c0n 2026

c0c0n is a 19 years old platform that is aimed at providing opportunities to showcase, educate, understand and spread awareness on Information Security, data protection, and privacy...

Venue & Date

c0c0n 3-Day Professional Training

Creating Custom Tooling for Offensive Security after 2025 - Beyond Autopilot Pentesting

Course Description:

Up until 2025, building exploits and offensive tooling required substantial time and deep engineering knowledge. In 2026, AI automation - Claude Code, Opus 4.X, similar agents - has taken over much of that engineering work, producing results at a pace that was unthinkable two years ago. Looking under the hood, however, the real differentiator is not prompting skills or model selection. It comes down to two things: defining precise goals and guidance for the AI, and building custom tools and workflows the AI can actually use.

The second point is massively underrated. Many of the impressive results people attribute to "AI" are really about plugging agents into well-designed pre-AI-era tooling and scaling its application. The next level involves creating specialized - sometimes single-use - tool harnesses that make AI agents genuinely powerful for vulnerability discovery, variant analysis, PoC development, and scaling attacks beyond standard autopentest output.

This training covers the practical offensive security applications of custom AI tooling: finding vulnerabilities, creating PoCs quickly, performing variant analysis, and scaling both human-developed and AI-developed attacks. It addresses LLM backend options - from convincing cloud providers to support legitimate offensive use cases, through to running local models with custom-coded agents or standard clients. Critically, it covers verification: AI output differs in type, volume, and reliability from human output, and getting this under control is the single most important skill to develop. By applying verification layers participants learn to profit from the positive side of AI while keeping the drawbacks in check.

Equally important: the training treats AI security tooling itself as attack surface. The code an AI agent analyses might be analysing the agent back. Prompt injection via target content, credential exfiltration through tool call abuse, supply-chain compromise of MCP servers and model weights - all are demonstrated live. Hardening patterns (isolation, input sanitization, operational discipline) are practised hands-on.

The third pillar is empirical measurement. "It works on my machine" is not an assessment methodology. Without benchmarking, every claim about AI-assisted security tooling is marketing. Participants learn how to design controlled corpora, define ground truth, run blind and time-boxed experiments, and avoid the common pitfalls (public CVE memorization, single-run variance, ignoring token cost). They leave with a benchmarking framework they can apply to their own pipelines.

The fourth pillar is performance and economics: latency budgets in agentic workflows, prompt caching, classical pre-filtering, batch API trade-offs, and how to achieve consistent results!

Course Content

Day 1 - Foundations & Frameworks
  • The 2026 AI-agent landscape for offensive security: Claude Code, Cursor, Codex CLI, Anthropic Agent SDK, OpenAI Agents SDK, LangGraph, CrewAI, AutoGen - strengths, weaknesses, and the right tool for each job
  • Prompting versus constraining: Claude Code / Codex FTW? When to constrain your agents and when not!/li>
  • Lab: setting up a local AI dev environment for offensive security
  • Lab: building an MCP server that wraps three security tools of the participant's choice (typed inputs, JSON output, enforced timeouts, parsed structured output)
  • The tool-harness pattern - wrapping classical scanners (Nmap, sqlmap, Nuclei, Burp, custom fuzzers) so AI agents call them safely
  • When to customize: from interactive Claude Code one-offs to fully custom orchestrated pipelines
  • LLM backend options: convincing cloud providers to support legitimate offensive use cases; running local models when you have to
Day 2 - Security of Security Tools and Hardening
  • Your AI security tooling is attack surface - what is in your tool's context window right now?
  • Prompt injection via target code: malicious comments, README payloads, supply-chain attacks; live demo of an SQLi that the AI is instructed to ignore
  • Credential exposure across environment, prompts, context, logging, and tool calls
  • Attacking tools and MCP servers - what to watch out for
  • Supply-chain attacks against AI tooling: malicious MCP servers, poisoned model weights, dependency confusion in AI libraries, model-provider compromise
  • Hardening: agent isolation (containers/VMs, network isolation, separate credential stores), input sanitization, operational discipline (review, rotate, air-gap)
  • Lab: exploiting a deliberately vulnerable AI agent setup
  • Lab: hardening a personal AI tooling stack from end to end
Day 3 - Benchmarking, Performance, and Production Patterns
  • Why benchmarking matters and how AI nondeterminism makes it hard/li>
  • The metrics that matter: detection rate, false-positive rate, time-to-finding, PoC viability, token cost, hallucination rate
  • Benchmark design principles - controlled corpus, blind targets, time-boxed runs, isolated context, comparison axes
  • Pitfalls: public CVE corpora measure memorization not capability; single-run results hide variance; missing ground truth
  • Worked example: an SQLi detection benchmark across manual / SQLMap / AI / AI+SQLMap and what the numbers actually say
  • Performance trade-offs: model size, prompt caching, classical pre-filter, batch API, smaller models for triage
  • Latency budgets in agentic workflows - when 10 fast tries beat one expensive answer
  • Determinism: why "temperature=0" lies, and what actually helps (seed, caching, finding-level cache, verification loops)
  • Skills vs. MCP tools - context efficiency in long-running agent sessions
  • Cost optimization in production: prompt caching, context pruning, focused tool output
  • Lab: building a custom benchmark for a vulnerability class chosen by the participant
  • Lab: optimizing a pipeline for cost, latency, and quality
  • Closing: the production-ready offensive AI workflow - classical tools sweep, small model triage, frontier model deep analysis on high-value targets only
Pre-requisite

  • Practical offensive security experience (pentesting, red teaming, vulnerability research, or exploit development)
  • Comfortable with Python and the Linux command line
  • Familiarity with at least one of: Nmap, sqlmap, Nuclei, Burp Suite, or equivalent
  • No AI or machine-learning background required

Participants Requirements (Hardware / Software / Cloud Accounts, etc):

  • Laptop with administrator/root rights
  • 16 GB RAM minimum, 32 GB recommended
  • 80 GB free disk space
  • Docker Desktop / Docker Engine or equivalent container runtime installed and tested
  • Python 3.11 or later with pip and uv
  • A modern browser and an SSH client
  • A code editor of choice (VS Code, Neovim, Cursor, etc.)
  • A GitHub account to be used for the training
  • A personal API key for at least one of: Anthropic API or OpenAI API (sandbox accounts with a token budget will be provided as fallback for participants who cannot bring their own keys)
  • Optional but recommended: a small VPS or cloud sandbox for evening practice

Who should attend
  • Pentesters and red teamers who want to integrate AI into their workflow without losing rigor
  • Security researchers interested in scaling vulnerability discovery and variant analysis
  • Tool developers building offensive harnesses
  • Application-security engineers who need to verify AI-produced findings before acting on them
What to expect
  • Hands-on labs every day - minimal lecture, maximum keyboard time
  • Reusable MCP and agent-SDK harness templates participants take home
  • A complete benchmarking framework participants can apply to their own pipelines
  • Live demonstrations of attacks on AI security agents and the hardening patterns that defeat them
  • Open discussion of operational pitfalls - what actually fails in production, not what looks good in slides
  • Honest, measurement-based assessment of where AI helps and where it hurts in offensive work
What not to expect
  • AI or machine-learning theory beyond what is directly relevant to building offensive tooling
  • A replacement for offensive security fundamentals - this training assumes you already have them
  • Prompt engineering 101 or "prompt hacks for hackers"
  • Vibe coding advice
  • "How to use ChatGPT to find vulnerabilities" walkthroughs
  • Vendor product demos or sales pitches
  • Pre-built turnkey agents that solve every problem - you will leave with patterns and templates, not a finished product
Takeaways

By the end of three days, participants take home: reusable MCP and agent-SDK harness templates; a working benchmarking framework; demonstrations of common attacks on AI agents and the hardening patterns that defeat them; and an honest, evidence-based view of where AI helps offensive operations, where it hurts, and where it makes no measurable difference.


Key takeaways:

  • Apply custom AI tooling and workflows to practical offensive security use cases
  • Set up a lab environment for AI-assisted security research
  • Create custom tools and harnesses for AI agents (MCP, Anthropic Agent SDK, custom orchestration)
  • efine goals and guidance precisely enough to get useful results
  • Save tokens by interweaving AI with classical methods
  • Verify AI output - manually and automatically
  • Recognize and defend against attacks on your AI tooling itself
  • Benchmark AI-assisted workflows empirically and reproducibly

Trainers

Markus Vervier

Security Researcher

PARTNERS