Data catalog / web-scraping
Web scraping
Read a company's website: the technologies and tracking pixels it runs, its meta tags and structured data, social profiles, email addresses, the full page as HTML or Markdown, its sitemap, and Similarweb traffic. Run one check for 1 or 2 credits, or all of them in one 5-credit call.
In short: RichAPI's web endpoints: POST /website_intelligence runs meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl and headers modules in one call for 5 credits (the modules field picks a subset; the rate stays 5). Single checks at 1 credit per call: /web_tech_stack, /web_pixels, /web_meta_tags, /web_json_ld, /web_social_links, /web_scrape (HTML and Markdown). /web_emails crawls several pages for 2 credits. /web_sitemap bills 1 credit per URL returned, capped by limit. /similarweb_scraper_sync bills 2 credits per domain. All take a url (Similarweb takes a domain) and an optional cache flag.
Last updated October 6, 2026
What a website tells you about a company
A company's site shows what it runs, how it markets and how to reach it. POST /website_intelligence runs eight checks on one URL in a single call: meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl and headers. Pass modules to run only some of them.
Each check also has its own endpoint. web_tech_stack detects the CMS, analytics, CDN, frameworks and payment tools. web_pixels reports Google Tag Manager, GA4, the Meta Pixel, the LinkedIn Insight Tag and the TikTok Pixel. web_social_links finds the company's profiles on LinkedIn, X, Facebook, Instagram, YouTube and TikTok. web_emails crawls a few pages for addresses. web_scrape returns the page as HTML and Markdown.
Endpoints and rates
| Endpoint | What it does | Credits | Billed |
|---|---|---|---|
/website_intelligence |
Flagship: comprehensive website report: meta tags, tech stack, pixels, social links, emails, SSL, headers in one call. | 5 | per call |
/web_tech_stack |
Detect 100+ technologies (CMS, analytics, CDN, frameworks, payments) + GTM intelligence signals. | 1 | per call |
/web_pixels |
Detect Google Tag Manager, GA4, Facebook Pixel, LinkedIn Insight, TikTok Pixel and more on any site. | 1 | per call |
/web_meta_tags |
Extract OpenGraph, Twitter Card, and SEO meta tags from any URL. | 1 | per call |
/web_json_ld |
Extract structured JSON-LD data (Schema.org) from any web page: products, articles, organizations. | 1 | per call |
/web_social_links |
Find all social media profile links (Facebook, Twitter, LinkedIn, Instagram, YouTube, TikTok, etc). | 1 | per call |
/web_emails |
Extract email addresses by crawling multiple pages of a website. | 2 | per call |
/web_scrape |
Scrape full page HTML and markdown with anti-bot protection via Firecrawl. | 1 | per call |
/web_sitemap |
Extract all URLs from a website's sitemap (XML, robots.txt, or crawl discovery). | 1 | per result |
/similarweb_scraper_sync |
Scrape Similarweb overview data for one or more domains. | 2 | per result |
Rates are read from the live OpenAPI spec. Credits are prepaid and never expire, and the price of a credit depends on your package: see pricing.
One call or several
website_intelligence costs 5 credits whichever modules you pick. Each single-check endpoint costs 1 credit, except web_emails at 2. So:
- For one to four checks, call the single endpoints. Tech stack plus pixels is 2 credits.
- For five or more,
website_intelligenceis cheaper and returns one response.
Two endpoints bill per result, so read them carefully. web_sitemap costs 1 credit per URL it returns, which makes limit the cost control: a site with 5,000 pages in its sitemap would cost 5,000 credits if you asked for all of them. similarweb_scraper_sync costs 2 credits per domain and returns Similarweb's overview of the site, including traffic and category.
Qualify on the website before you buy contacts
A 1-credit website check is cheaper than finding and verifying a contact, so run it first and drop the accounts that do not fit:
- Qualify accounts by what they run, then find the people uses
web_tech_stack. - Pixels first, stack second is a two-call pass: which ad pixels a site loads, then what else it runs.
- Qualify domains on traffic cuts a domain list on Similarweb data before any contact spend.
Detailed pages: detect the technology a website runs on and extract email addresses from a website.
What the checks cannot see
cacheis off by default, so each call reads the live site. Turn it on for repeat checks where yesterday's answer is fine.- Detection finds what a site loads in public pages. A tool used only behind a login, or only in the back office, will not show up.
web_scrapehandles bot protection, but a page that needs a login still returns the login page.
Reference
| Name | Type | Required | Description |
|---|---|---|---|
url | string | Yes | Website URL to analyze |
cache | boolean | No | Use cached data if available |
modules | array of object | No | Specific modules to run (defaults to all). Options: meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl, headers |
urlstring · Required- Website URL to analyze
cacheboolean · Optional- Use cached data if available
modulesarray of object · Optional- Specific modules to run (defaults to all). Options: meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl, headers
Request
Minimum required parameters for a web scraping call.
{
"url": "https://stripe.com",
"modules": [
"tech_stack",
"pixels",
"social_links",
"emails"
]
}See it in a workflow
Playbooks
Real patterns, recipes, and prompts other builders run on RichAPI
Developer Docs
Auth, request shape, and error handling
FAQ
