Skip to content
New

DeepSeek V4.1 Flash free for 7 days: 10M tokens a day after a top-up of $10 or more. Until Nov 30.

How it works
aeondave/hakrawlerWeb and bug bounty

hakrawler

⁨Auth/lab ref: Fast Go web crawler for discovering URLs, endpoints, and JavaScript files. For crawling web applications to build a URL inventory before fuzzing or during OSINT on web infrastructure.⁩

v2026.11.13-21cd5684 installs+4 in 7 days39 StarsMITsynced 10 hours ago

Install

No NotHoly CLI yet? Install it first.

$ curl -fsSL https://notholy.com/install.sh | sh
$ notholy skills install aeondave/hakrawler

Writes to ⁦~/.notholy/skills⁩ after checking the signature and the SHA-256.

SignatureSigned, ed25519
vFLAzLpVaq…dpXBrJAA==The CLI checks the SHA-256 and the signature before it writes a file.
Packagef87f9855…8f8ffd41
f87f9855fc18…41638f8ffd412 files · ⁦2.6 KB⁩
ScanLow1 finding
  • Links to outside domains
See the full scan
Sourcegithub.com/AeonDave/malskill/tree/main/offensive-tools/recon/hakrawler@21cd568

Fast Go web crawler — discover URLs, JS files, forms, and endpoints.

Quick Start

bash
go install github.com/hakluke/hakrawler@latest

# Crawl a domain
echo https://target.com | hakrawler

# Depth 3, include subdomains
echo https://target.com | hakrawler -d 3 -subs

# Output as JSON
echo https://target.com | hakrawler -json

# Pipe multiple domains
cat domains.txt | hakrawler -d 2

Core Flags

Flag Purpose
-d N Depth (default: 1)
-subs Include subdomains
-u Unique URLs only
-insecure Skip TLS verification
-t N Threads
-timeout N Timeout per request (s)
-H "K:V" Custom header
-json JSON output
-scope REGEX Limit to URL pattern
-plain Print plain text (no color)
-proxy <url> HTTP/SOCKS5 proxy
-cookie <str> Cookie string
-dr Disable following redirects
-w N Wait N ms between requests

Common Workflows

Build URL inventory for fuzzing:

bash
echo https://target.com | hakrawler -d 3 -u | tee urls.txt
# Feed to ffuf
ffuf -w urls.txt:URL -u URL -mc 200

Discover JS files:

bash
echo https://target.com | hakrawler -d 2 | grep "\.js$"

Combine with httpx for live check:

bash
cat domains.txt | hakrawler | httpx -silent -mc 200

Scope-limited crawl (stay in scope):

bash
echo https://target.com | hakrawler -d 3 -scope ".*\.target\.com.*" -u

Extract API endpoints:

bash
echo https://target.com | hakrawler -d 3 -u | \
  grep -E "(/api/|/v[0-9]+/|\.json|\.xml)" | sort -u

Form action discovery:

bash
echo https://target.com | hakrawler -json | \
  jq -r 'select(.type=="form") | .source'

Multi-target via live hosts:

bash
subfinder -d target.com -silent | \
  httpx -silent | \
  hakrawler -d 2 -u | sort -u > all_urls.txt

Resources

File When to load
references/crawl-tips.md Scope filtering, JS analysis, pipeline patterns, JS secret extraction

Files in this version

Permissions

PermissionDeclaredFound by the scan
Reads filesYesYes
Writes filesYesYes
Runs shell commandsYesYes
Uses the networkYesYes
Uses connectorsNoNo
Drives a browserYesYes

Scan findings

Reviewed on Nov 13, 2026

  1. InfoLink · Links to outside domains

A clean scan lowers the risk but does not prove a package is safe. Read what you install.

VersionPublishedCommitSHA-256SignaturePermission change
v2026.11.13-21cd568Nov 13, 202621cd568f87f9855Signed–

Ask anything your scope allows.

Create an account, add credits and ask the first question in the chat or the terminal.

  1. 1/3

    Create the account

    Individual or company. You can switch to a company later without losing balance or keys.

    IndividualCompany
  2. 2/3

    Add credits

    By card. Pay per token, no subscription.

    $5.00minimum deposit
  3. 3/3

    Ask

    In the chat, or install the CLI and run notholy login in your terminal.

    $ notholy login