Crawler & Lead Enrichment
Crawler & Lead Enrichment
5 min readDeep Website Contact Crawler
How our multi-page website crawler inspects subpages to extract decision-maker contact details safely.
Deep Website Contact Crawler
The LeadForge contact crawler traverses target company websites to find decision-maker contact info without relying on stale third-party databases.
1. Traversal Strategy
- Homepage First: Parses root
/to collect header and footer links. - High-Yield Subpages: Traverses subpage links matching keywords:
/contact,/contact-us,/reach-us/about,/about-us,/team,/company/privacy,/terms- Depth & Bounds:
max_depth = 2max_pages = 10timeout_seconds = 15
2. Extracted Data Endpoints
- Emails: Combined regex matching and
mailto:attributes, with built-in false positive filtering (ignoring.png,.svg,wixpress.com, etc.). - Phones: Normalized from
tel:links and international regex standards. - WhatsApp: Direct links extracted from
wa.me/andapi.whatsapp.com/. - Social Handles: LinkedIn, X (Twitter), Facebook, Instagram, YouTube.
Was this article helpful?
Help us improve LeadForge documentation with your feedback.