katana
Auth/lab ref: ProjectDiscovery web crawler for endpoint and JS-endpoint discovery.
v2026.11.13-21cd5683 installs+3 in 7 days39 StarsMITsynced 10 hours ago
Install
No NotHoly CLI yet? Install it first.
$ curl -fsSL https://notholy.com/install.sh | sh$ notholy skills install aeondave/katanaWrites to ~/.notholy/skills after checking the signature and the SHA-256.
SignatureSigned, ed25519
Packageaa522836…a356c396
aa52283683a1…5b12a356c3961 file · 2.0 KBScanLow1 finding
- Links to outside domains
Sourcegithub.com/AeonDave/malskill/tree/main/offensive-tools/recon/katana@21cd568
On this page
ProjectDiscovery web crawler — endpoints, JS paths, XHR calls, and API routes from modern web apps.
Quick start
# Single URL crawl
katana -u https://target.com
# Crawl with JS parsing (extract endpoints from JS files)
katana -u https://target.com -jc
# Headless mode (renders JS — required for SPA/React/Angular apps)
katana -u https://target.com -hl
# Output to file
katana -u https://target.com -jc -o endpoints.txt
# Multiple targets from file
katana -list urls.txt -jc -o all_endpoints.txtCrawling scope
# Default scope follows the registrable domain; review it against authorization
katana -u https://target.com -jc
# Restrict to the input host
katana -u https://target.com -jc -fs fqdn
# Depth control
katana -u https://target.com -jc -d 5 # max depth 5 (default: 3)
# Concurrency
katana -u https://target.com -jc -c 20 -p 20 # 20 concurrent crawlers, 20 parallelism
# Rate limit (requests per second)
katana -u https://target.com -jc -rl 50
# Agent-safe JSONL baseline with bounded depth and static asset filtering
katana -u https://target.com -d 3 -jc -kf robotstxt -c 10 -p 10 -rl 50 -timeout 10 -retry 1 -ef png,jpg,jpeg,gif,svg,css,woff,woff2,ttf,eot,map -silent -j -o katana.jsonlJS endpoint extraction
Katana's JS crawling (-jc) uses JSLuice and regex patterns to extract endpoints from JavaScript files. This is the primary value over generic crawlers.
# JS crawl + XHR extraction in JSONL (headless mode)
katana -u https://target.com -hl -jc -xhr -j
# Deeper JS parsing (memory intensive)
katana -u https://target.com -d 5 -jc -jsl -kf all -c 10 -p 10 -rl 50 -o katana_urls.txt
# Extract all JS file URLs only
katana -u https://target.com -jc | grep "\.js$" > js_files.txt
# Show discovered endpoints from JS (exclude static assets)
katana -u https://target.com -jc | grep -v "\.(png|jpg|gif|svg|ico|woff|css)$"
# Filter for API paths
katana -u https://target.com -jc | grep -E "(/api/|/v[0-9]+/|/graphql|/rest/)"Headless mode (SPA/React/Angular)
Standard crawler misses dynamically rendered content. Use headless for apps that require JavaScript execution.
# Headless Chrome/Chromium required
katana -u https://target.com -hl -jc -d 3
# Headless with DOM wait
katana -u https://target.com -hl -jc -pls domcontentloaded -dwt 5
# Headless with system Chrome and XHR extraction
katana -u https://target.com -hl -sc -nos -xhr -j -o katana_headless.jsonl
# Authenticated crawl — provide session cookie
katana -u https://target.com -hl -H "Cookie: session=<token>" -jcAuthentication and custom headers
# Bearer token
katana -u https://api.target.com -H "Authorization: Bearer <token>" -jc
# Multiple headers
katana -u https://target.com -H "X-Api-Key: abc123" -H "Accept: application/json" -jc
Pipeline integration
Katana integrates with the ProjectDiscovery ecosystem:
# httpx → katana: crawl all live web hosts
httpx -l live_hosts.txt -silent | katana -jc -o all_endpoints.txt
# subfinder → httpx → katana pipeline
subfinder -d target.com -silent | httpx -silent | katana -jc -o endpoints.txt
# Feed into nuclei for vuln scanning
katana -u https://target.com -jc -o endpoints.txt
nuclei -l endpoints.txt -t exposures/ -t vulnerabilities/Output and filtering
# JSON output (structured for parsing)
katana -u https://target.com -jc -jsonl -o katana.jsonl
# Known files (robots.txt and sitemap.xml)
katana -u https://target.com -kf all -d 3 -silent
# Filter by extension (exclude static assets)
katana -u https://target.com -jc -ef png,jpg,jpeg,gif,svg,css,woff,woff2,ttf,eot,map
# Show only unique paths (deduplicate)
katana -u https://target.com -jc | sort -u > unique_endpoints.txt
# Extract parameters from found URLs
katana -u https://target.com -jc | grep "?" | cut -d"?" -f2 | tr "&" "\n" | cut -d"=" -f1 | sort -uOPSEC notes
- Standard mode: one request per link — low noise but misses JS-rendered content.
- Headless mode: launches a real browser — higher resource use, slightly more detectable.
- Use
-rlrate limiting on sensitive or production scopes. -kf robotstxtadds known-file crawling; it does not enforce robots.txt rules. It requires crawl depth of at least 3.
When to use vs. other crawlers
| Scenario | Tool |
|---|---|
| Modern SPA/React/Angular | katana -headless |
| API endpoint extraction from JS | katana -jc |
| Fast directory brute-force | feroxbuster |
| Historical URL collection | gau |
| Fast link extraction from static HTML | hakrawler |
Files in this version
- SKILL.md4.8 KB
Permissions
| Permission | Declared | Found by the scan |
|---|---|---|
| Reads files | No | No |
| Writes files | Yes | Yes |
| Runs shell commands | Yes | Yes |
| Uses the network | Yes | Yes |
| Uses connectors | No | No |
| Drives a browser | Yes | Yes |
Scan findings
Reviewed on Nov 13, 2026
- InfoLink · Links to outside domains
A clean scan lowers the risk but does not prove a package is safe. Read what you install.
| Version | Published | Commit | SHA-256 | Signature | Permission change |
|---|---|---|---|---|---|
| v2026.11.13-21cd568 | Nov 13, 2026 | 21cd568 | aa522836 | Signed | – |
More from AeonDave
All from this publisherMore in Recon and OSINT
See the category- gobusteraeondave/gobuster4
- ghuntaeondave/ghunt4
- stride-threat-modelingsecurityskills/stride-threat-modeling3
- attack-surface-reconsecurityskills/attack-surface-recon3
- bug-bounty-recon-pipelinesecurityskills/bug-bounty-recon-pipeline3
- implementing-attack-surface-managementmukul975/implementing-attack-surface-management3
Ask anything your scope allows.
Create an account, add credits and ask the first question in the chat or the terminal.
- 1/3
Create the account
Individual or company. You can switch to a company later without losing balance or keys.
IndividualCompany - 2/3
Add credits
By card. Pay per token, no subscription.
$5.00minimum deposit - 3/3
Ask
In the chat, or install the CLI and run notholy login in your terminal.
$ notholy login