Website Scraper

Crawl company websites for publicly listed business emails. Each email is saved with the page it was found on and the time it was collected.

Website URLsOne per line. Bare domains like acme-packaging.com are fine. Duplicates and invalid entries are reported, not silently dropped.Job name (optional)

Max pages per website1–100Crawl depth0 = homepage only (max 4)Delay between requests (s)Per website, min 0.5sWebsites in parallel1–10

Follow links to other websitesOff by default. When off, only the same site is crawled.Check email domains (DNS/MX) when finishedFree DNS lookup only. It never contacts a mail server.

Prospect keywords (optional)One per line or comma-separated, e.g. “custom packaging”. Matches are recorded in each lead’s notes.

Only keep websites that match a keywordSites without any keyword on their pages are skipped (their emails are discarded).Tags for these leads (optional)

Testing without the internet?

Run python -m tests.fixture_server in the backend folder and set TEST_FIXTURE_HOSTS=127.0.0.1:8099,localhost:8099 in backend/.env. Leads from it are flagged TEST DATA and hidden from the dashboard and exports unless you opt in.