Changelog
Release history for the Site Map & Tracker Audit: launch, the audit.digitalinteractif.com migration, render mode, and subdomain discovery.
2026-09-27
- Multi-source subdomain discovery. Subdomain discovery now unions four free sources: Certificate Transparency logs (crt.sh), the urlscan.io public scan index, AlienVault OTX passive DNS (when an API key is configured), and DNS common-name probing. Unioned, deduplicated, sorted, and capped at 50.
- True global page budget. Max pages is now one budget shared by the parent domain and all subdomains; parent sitemap URLs take priority and subdomain URLs fill the remainder.
- Raised caps. Subdomain cap raised from 20 to 50; per-subdomain page cap raised from 100 to 200. Both are environment-overridable.
- Wildcard-DNS guard. The finder now resolves a random bogus hostname first; if it resolves (wildcard DNS), wordlist probing is skipped so results aren't polluted with fake names.
- Anti-detection crawling. Six rotating browser-like user-agent strings, browser-like headers, randomized request delays (jitter), and
robots.txt Crawl-delay support.
- Browser-render mode. Optional headless Chromium rendering (one browser per audit, sequential pages, static fallback) catches trackers injected at runtime by JavaScript; the static-scan limitation is disclosed on the form.
- Migration to audit.digitalinteractif.com. The tool moved from the root domain to its own subdomain; the root is now a brand hub with tool routes redirecting one hop to the audit subdomain.
- Content build-out. This page, the how-it-works/features/pricing/FAQ pages, and a ten-guide library covering beacons, tag managers, sitemaps, robots.txt, consent banners, and subdomain discovery.
2026-09-26
- Public launch. The Site Map & Tracker Audit went live: enter any public domain, get sitemap enumeration (
robots.txt → sitemap recursion), per-page SEO audit (status, title, meta description, H1, canonical, word count), and regex scanning against 40+ tracker signatures with identifier extraction.
- Two discovery modes. Sitemaps only (fast) and Sitemaps + link crawl (thorough) with breadth-first internal link crawling for pages missing from sitemaps.
- Results infrastructure. Live job pages with progress, pages and beacons tables, CSV downloads, run deletion, per-user run history via Google sign-in, and usage logging of every run.
- Polite crawling from day one. Realistic user-agents, request jitter, and
robots.txt compliance; deterministic pipeline with zero AI tokens per run.
- Performance hardening. Streaming per-page processing so large audits don't accumulate memory; startup reconciliation so interrupted jobs are marked failed instead of spinning forever.