waymore

No entries match these filters. Clear filters

1. v8.7 Mar 8, 2026 · release notes

   waymore v8.7 auto-creates config.yml with defaults when missing from the expected config directory.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v8.7 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v8.7

2. v8.6 Mar 3, 2026 · release notes

   v8.6 adds cdxKeywordsFilter() for -ko and -ra patterns with improved MIME validation

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v8.6 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v8.6

   • Wraps -ko / --regex-after patterns with cdxKeywordsFilter() to auto-apply .* prefix/suffix for Wayback CDX and Common Crawl APIs, enabling flexible substring anchoring.
   • Updates MIME type validation regex for -ft / --filter-mime-types and -mt / --match-mime-types to accept all RFC-valid token characters (e.g., ., _, !).
   • Adds immediate regex validation for -ko and -ra arguments with a clear error message and hint to use single quotes.

   3 details in Everything

3. v8.1 Jan 24, 2026 · release notes

   waymore v8.1 auto-creates config.yml with defaults if missing on first run.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v8.1 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v8.1

   • Auto-creates config.yml with default values if not found in the default location at startup.

   1 detail in Everything

4. v8.0 Jan 22, 2026 · release notes

   waymore v8.0 adds GhostArchive as a URL and response source, with new exclusion flag and provider option.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v8.0 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v8.0

   └──▷ TRY IT
   Pull all archived URLs for a target including GhostArchive results, which were unavailable before v8.0.
   copy

   $ waymore -i example.com -mode U --providers ghostarchive

   Download archived HTTP responses from GhostArchive WARC files while skipping GhostArchive link extraction to avoid noise.
   copy

   $ waymore -i example.com -mode R -xga

   • Adds GhostArchive (ghostarchive.org) as a new URL source for -mode U and -mode R, crawling paginated HTML pages to extract archived URLs and downloading WARC files for HTTP responses.
   • New -xga flag to exclude GhostArchive from URL link checks.
   • Extends --providers to accept ghostarchive as a valid provider value.
   • Adds .avif to FILTER_URL and image/avif to FILTER_MIME defaults so AVIFAVIFAn open image format based on the AV1 video codec, maintained by the Alliance for Open Media, offering smaller file sizes than JPEG or PNG at comparable quality — useful when a tool serves image-heavy web interfaces. images are filtered from results.
   • application/pdf removed from FILTER_MIME defaults so PDF files are no longer filtered out — surfaces potentially valuable archived documents.

   5 details in Everything

   └──▷ BREAKING ON UPGRADE

   • !application/pdf is removed from FILTER_MIME in config.yml and DEFAULT_FILTER_MIME, meaning PDFs that were previously filtered out will now appear in results on upgrade.
5. v7.7 Jan 16, 2026 · release notes

   waymore v7.7 expands binary file handling in -mode R and adds more audio/video filters to config

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v7.7 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v7.7

   • Adds more audio and video extensions to FILTER_URL defaults and config.yml to broaden automatic URL filtering.
   • Adds more audio and video MIME types to FILTER_MIME defaults and config.yml.
   • Introduces BINARY_EXTENSIONS constant covering 50+ binary file extensions for accurate binary detection during downloads.
   • Introduces BINARY_MIME_TYPES constant covering 40+ binary MIME types for accurate binary detection during downloads.
   • New isBinaryContent() function inspects actual content bytes (magic bytes) before falling back to Content-Type header or URL extension, ensuring HTML error pages aren't misidentified as binary.

   +4 more show less

   • Binary files downloaded with -mode R now use the Wayback Machine id_ modifier (e.g., /web/20090315210455id_/http://...) to retrieve raw originals without Wayback Machine modifications.
   • Binary files with no determinable extension now saved as .bin instead of .unknown.
   • The --source-ip option is now shown in output only when explicitly configured (visible in verbose -v mode).
   • Adds extra debug output showing the file currently being processed to assist in diagnosing hangs.

   9 details in Everything

6. v7.6 Jan 14, 2026 · release notes

   waymore v7.6 adds source IP binding so outbound requests use a specific whitelisted interface on multi-homed hosts.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v7.6 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v7.6

   └──▷ TRY IT
   Force waymore to egress through a specific whitelisted IP on a multi-homed host, e.g. when a target only allows requests from a known scanner IP.
   copy

   $ waymore -i example.com --source-ip 203.0.113.42

   • Adds --source-ip / --bind-ip CLI argument and SOURCE_IP config option to bind all outbound HTTP/HTTPSHTTPSHTTP carried over an encrypted TLS connection. It protects traffic in transit and lets a browser verify the server's certificate. requests to a specific local IP address.

   1 detail in Everything

7. v7.5 Jan 10, 2026 · release notes

   waymore v7.5 adds automatic IntelX endpoint fallback, switching from paid to free tier on auth errors.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v7.5 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v7.5

   • Adds automatic fallback between paid (2.intelx.io) and free (free.intelx.io) Intelligence X endpoints, switching on 401/402/403 errors so users with either API key type get results without manual reconfiguration.
   • Adds thread-local storage for IntelX URL configuration to support concurrent IntelX operations.

   2 details in Everything

8. v7.3 Dec 27, 2025 · release notes

   waymore v7.3 adds Telegram webhook notifications via new -nt/--notify-telegram flag.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v7.3 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v7.3

   └──▷ TRY IT
   Get a Telegram alert when a long waymore crawl finishes, so you don't have to watch the terminal.
   copy

   $ waymore -i example.com -nt

9. v7.2 Dec 25, 2025 · release notes

   waymore v7.2 adds Telegram webhook notifications when scans complete.

   └──▷ GET THIS VERSION

   copy

   $ git clone --branch v7.2 https://github.com/xnl-h4ck3r/waymore.git
   # already have the repo? check out this version:
   $ git checkout v7.2

   └──▷ TRY IT
   Get a Telegram ping when a long waymore crawl finishes, so you don't have to babysit the terminal.
   copy

   $ waymore -i example.com -nt

10. v7.1 Dec 8, 2025 · release notes

    waymore v7.1 adds /_incapsula_resource to default URL filters to exclude noisy Incapsula CDNCDNA content delivery network, servers distributed across locations that cache and serve content near readers. It can reduce loading time and traffic to the original server. responses

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v7.1 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v7.1

    • Adds /_incapsula_resource to FILTER_URL in config.yml and the built-in default constant, automatically excluding Incapsula CDN noise from results.

    1 detail in Everything

11. v7.0 Dec 3, 2025 · release notes

    waymore v7.0 delivers 2-4x faster multi-source URL collection via async concurrent fetching across all six sources.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v7.0 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v7.0

    • Adds async concurrent fetching across all six URL sources (Wayback Machine, Common Crawl, AlienVault OTXOTXAlienVault's Open Threat Exchange, a community platform where researchers share indicators of compromise; cyber tools integrate it to pull live threat intelligence feeds without building their own collection infrastructure., URLScan, VirusTotal, Intelligence X) for 2-4x faster multi-source runs.
    • One source failure no longer halts others — concurrent error handling keeps remaining sources running.
    • Wayback Machine requests now use streaming (stream=True) so URLs collected before a dropped connection are saved rather than lost.
    • Adds per-source unique link counts in output, showing how many distinct URLs each source contributed.
    • Reduces memory usage by storing links in source-specific sets during processing and merging only at the end, clearing source sets immediately after.

    5 details in Everything

    └──▷ BREAKING ON UPGRADE

    • !Minimum Python version is now 3.7+ (required for async/await support); setups running Python 3.6 or earlier will break.
    • !The default value for -lcc/--limit-common-crawl is now 1 (previously unset/different), which may change Common Crawl result volume in existing scripts that relied on the old default.
    • !The default value for -p/--processes is now 2 (previously unset/different), which may change resource usage in environments that relied on the old default.
12. v6.6 Nov 10, 2025 · release notes

    waymore v6.6 extends --from-date/--to-date filtering to Wayback URL collection, Common Crawl, AlienVault, and VirusTotal.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v6.6 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v6.6

    └──▷ TRY IT
    Collect URLs from all sources (Wayback, Common Crawl, AlienVault, VirusTotal) scoped to a specific year — useful for narrowing recon to a known vulnerable window.
    copy

    $ waymore -i example.com -mode U -from 20230101 -to 20231231

    Download archived responses for a target within a date range without also applying the date filter to URL collection (filter-responses-only mode).
    copy

    $ waymore -i example.com -mode R -from 20230101 -to 20231231 -f

    • Applies -from/--from-date and -to/--to-date date bounds to Wayback Archive URL collection (mode U), not just response downloads (mode R).
    • Extends date-range filtering to Common Crawl, AlienVault OTXOTXAlienVault's Open Threat Exchange, a community platform where researchers share indicators of compromise; cyber tools integrate it to pull live threat intelligence feeds without building their own collection infrastructure., and VirusTotal URL sources — Common Crawl index selection now driven by these flags instead of the removed -lcy argument.
    • Date filters are skipped for URL collection when -f/--filter-responses-only is passed, preserving existing filter-only workflows.

    3 details in Everything

    └──▷ BREAKING ON UPGRADE

    • !The -lcy argument is removed; use -from/--from-date and -to/--to-date to control which Common Crawl indexes are queried.
13. v6.2 Oct 9, 2025 · release notes

    waymore v6.2 adds --stream mode for real-time URL output to STDOUT as they are discovered.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v6.2 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v6.2

    └──▷ TRY IT
    Pipe live URL discoveries into a grep filter during a recon session without waiting for waymore to finish.
    copy

    $ waymore -i example.com -mode U --stream | grep '\.js'

    Stream URLs to STDOUT in real time while also saving a deduplicated copy to a file for later analysis.
    copy

    $ waymore -i example.com -mode U --stream -oU results.txt

    • Adds --stream argument to output URLs to STDOUT in real time as they are found (works with -mode U only; use -oU to also save deduplicated results to file).
    • Enhances --version to display whether the installed version is outdated alongside the version number.

    2 details in Everything

14. v6.1 Mar 20, 2025 · release notes

    waymore v6.1 adds URLScan archived response retrieval alongside the Wayback Machine.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v6.1 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v6.1

    • Adds retrieval of archived responses from URLScan (via https://urlscan.io/dom/{UUID}) in addition to the Wayback Machine, with the same link-extraction processing applied.
    • Includes the waymore version in the User-Agent header when making requests to URLScan.
    • Renames the output index file from index.txt to waymore_index.txt to allow xnLinKFinder to better identify a waymore response directory.

    3 details in Everything

    └──▷ BREAKING ON UPGRADE

    • !The output index file is renamed from index.txt to waymore_index.txt; any scripts or tools that reference index.txt by name will no longer find it.
15. v5.0 Mar 4, 2025 · release notes

    waymore v5.0 adds Intelligence X (intelx.io) as a URL source with a new exclusion flag.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v5.0 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v5.0

    └──▷ TRY IT
    Skip the Intelligence X source (e.g., no paid key available) while still querying all other sources.
    copy

    $ waymore -i example.com -xix

    • Adds Intelligence X (intelx.io) as a new URL discovery source via their paid /phonebook/search API.
    • New -xix flag to exclude Intelligence X from URL collection runs.
    • New INTELX_API_KEY config key in config.yml to authenticate with the Intelligence X API.

    3 details in Everything

16. v4.6 Nov 23, 2024 · release notes

    waymore v4.6 adds MIME type filtering/matching flags and a --providers flag for selecting URL sources à la gau.

    └──▷ GET THIS VERSION

    copy

    $ git clone --branch v4.6 https://github.com/xnl-h4ck3r/waymore.git
    # already have the repo? check out this version:
    $ git checkout v4.6

    └──▷ TRY IT
    Limit sources to Wayback Machine and URLScan only — useful when you want to skip slow or unreliable providers like Common Crawl.
    copy

    $ waymore -i example.com --providers wayback,urlscan

    Collect only JavaScript and JSON responses by matching on MIME type — cuts noise when recon-ing for JS endpoints.
    copy

    $ waymore -i example.com -mt application/javascript,application/json

    Exclude image and font MIME types from results to focus on document and script URLs.
    copy

    $ waymore -i example.com -ft image/png,image/jpeg,font/woff2

    • New -ft flag to specify MIME types to filter, overriding the FILTER_MIME list in config.yml.
    • New -mt flag to specify MIME types to match, replacing the default FILTER_MIME filtering or -ft filtering.
    • New --providers flag to select URL sources (wayback, commoncrawl, otx, urlscan, virustotal) as a comma-separated list, overriding individual exclude arguments like -xwm, -xcc, etc.
    • Verbose mode (--verbose) now displays the names of providers being searched instead of the exclude arguments.

    4 details in Everything

    └──▷ BREAKING ON UPGRADE

    • !The default value of -lcc changes from 3 to 1, reducing Common Crawl index lookups on upgrade without explicit configuration.
    • !The Common Crawl HTTP adapter retry count (HTTP_ADAPTER_CC) changes from retries+20 to retries+3, which may cause more Common Crawl requests to fail faster rather than retrying.