scrapd fetches public pages as scrapd-bot, respects robots.txt, never fetches private addresses, and never stores page content beyond a one hour result cache.
Questions
What does scrapd do?
It turns one public web page into structured data. You paste a URL and choose a table, JSON, CSV, Markdown or a custom instruction. The page is fetched, stripped of navigation, ads and scripts, and AI arranges the remaining content into the shape you picked. It reads HTML pages up to 500 KB and does not handle other file types.
Is scrapd free and can it scrape pages behind a login or paywall?
It is free for 3 pages per day with no account, resetting at midnight UTC, with pages up to 2 MB and CSV download included. Pro, coming soon at 9 dollars a month, adds more pages per day, JSON downloads and batches of up to 10 URLs. It respects robots.txt and does not try to get around logins or paywalls. Results are cached for 1 hour and raw page content is never stored.
How do I convert a web page into a table or CSV?
Paste the page address, select table or CSV as the output and run it. The tool picks the columns from the repeating content on the page, such as a product list or a directory. If you need specific fields, use the custom option and describe them in a sentence. Downloading the result as a CSV or JSON file requires Pro.