Data catalog / web-scraping

Web scraping

Read a company's website: the technologies and tracking pixels it runs, its meta tags and structured data, social profiles, email addresses, the full page as HTML or Markdown, its sitemap, and Similarweb traffic. Run one check for 1 or 2 credits, or all of them in one 5-credit call.

In short: RichAPI's web endpoints: POST /website_intelligence runs meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl and headers modules in one call for 5 credits (the modules field picks a subset; the rate stays 5). Single checks at 1 credit per call: /web_tech_stack, /web_pixels, /web_meta_tags, /web_json_ld, /web_social_links, /web_scrape (HTML and Markdown). /web_emails crawls several pages for 2 credits. /web_sitemap bills 1 credit per URL returned, capped by limit. /similarweb_scraper_sync bills 2 credits per domain. All take a url (Similarweb takes a domain) and an optional cache flag.

Last updated October 6, 2026

What a website tells you about a company

A company's site shows what it runs, how it markets and how to reach it. POST /website_intelligence runs eight checks on one URL in a single call: meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl and headers. Pass modules to run only some of them.

Each check also has its own endpoint. web_tech_stack detects the CMS, analytics, CDN, frameworks and payment tools. web_pixels reports Google Tag Manager, GA4, the Meta Pixel, the LinkedIn Insight Tag and the TikTok Pixel. web_social_links finds the company's profiles on LinkedIn, X, Facebook, Instagram, YouTube and TikTok. web_emails crawls a few pages for addresses. web_scrape returns the page as HTML and Markdown.

Endpoints and rates

Endpoint What it does Credits Billed
/website_intelligence Flagship: comprehensive website report: meta tags, tech stack, pixels, social links, emails, SSL, headers in one call. 5 per call
/web_tech_stack Detect 100+ technologies (CMS, analytics, CDN, frameworks, payments) + GTM intelligence signals. 1 per call
/web_pixels Detect Google Tag Manager, GA4, Facebook Pixel, LinkedIn Insight, TikTok Pixel and more on any site. 1 per call
/web_meta_tags Extract OpenGraph, Twitter Card, and SEO meta tags from any URL. 1 per call
/web_json_ld Extract structured JSON-LD data (Schema.org) from any web page: products, articles, organizations. 1 per call
/web_social_links Find all social media profile links (Facebook, Twitter, LinkedIn, Instagram, YouTube, TikTok, etc). 1 per call
/web_emails Extract email addresses by crawling multiple pages of a website. 2 per call
/web_scrape Scrape full page HTML and markdown with anti-bot protection via Firecrawl. 1 per call
/web_sitemap Extract all URLs from a website's sitemap (XML, robots.txt, or crawl discovery). 1 per result
/similarweb_scraper_sync Scrape Similarweb overview data for one or more domains. 2 per result

Rates are read from the live OpenAPI spec. Credits are prepaid and never expire, and the price of a credit depends on your package: see pricing.

One call or several

website_intelligence costs 5 credits whichever modules you pick. Each single-check endpoint costs 1 credit, except web_emails at 2. So:

  • For one to four checks, call the single endpoints. Tech stack plus pixels is 2 credits.
  • For five or more, website_intelligence is cheaper and returns one response.

Two endpoints bill per result, so read them carefully. web_sitemap costs 1 credit per URL it returns, which makes limit the cost control: a site with 5,000 pages in its sitemap would cost 5,000 credits if you asked for all of them. similarweb_scraper_sync costs 2 credits per domain and returns Similarweb's overview of the site, including traffic and category.

Qualify on the website before you buy contacts

A 1-credit website check is cheaper than finding and verifying a contact, so run it first and drop the accounts that do not fit:

Detailed pages: detect the technology a website runs on and extract email addresses from a website.

What the checks cannot see

  • cache is off by default, so each call reads the live site. Turn it on for repeat checks where yesterday's answer is fine.
  • Detection finds what a site loads in public pages. A tool used only behind a login, or only in the back office, will not show up.
  • web_scrape handles bot protection, but a page that needs a login still returns the login page.

Reference

urlstring · Required
Website URL to analyze
cacheboolean · Optional
Use cached data if available
modulesarray of object · Optional
Specific modules to run (defaults to all). Options: meta_tags, json_ld, pixels, tech_stack, social_links, emails, ssl, headers

Request

Minimum required parameters for a web scraping call.

Request
{
  "url": "https://stripe.com",
  "modules": [
    "tech_stack",
    "pixels",
    "social_links",
    "emails"
  ]
}

See it in a workflow

Playbooks

Real patterns, recipes, and prompts other builders run on RichAPI

Start free with 100 credits

Developer Docs

Auth, request shape, and error handling

See Documentation

FAQ

Frequently asked questions

Read a company's website: the technologies and tracking pixels it runs, its meta tags and structured data, social profiles, email addresses, the full page as HTML or Markdown, its sitemap, and Similarweb traffic. Run one check for 1 or 2 credits, or all of them in one 5-credit call.
Every endpoint is billed from the same credit pool, at the published rate on /pricing — never a separate contract per endpoint.
Yes — the same endpoint is reachable from an MCP client (Claude, ChatGPT, Cursor, Windsurf) using the same key and credit pool. See /mcp.

Related data