The open web

Given a domain, returns how many distinct anchor texts its backlinks use, and the first 1 or 100 of those anchors with their stats: rank,…

Given a domain, returns how many of its pages the backlink index holds, and the first 1 or 100 of them in index order. Each page has its…

Given a domain, returns how many other domains share referring domains with it, with very large sites left out, and the first 1 or 100 of…

Takes no input and lists the field names of a web backlink dataset that can be used to filter or sort it, grouped by data view (backlinks,…

Given one or two domains, returns a spam score for each: a 0 to 100 rating of how spam-like the domain's backlink profile looks, higher…

Given one or two full page URLs, returns a backlink summary for each page: its rank and its domain's rank (0 to 1000), backlink count,…

Queues a background job that warms the cache for a domain's brand data or styleguide extraction so a later lookup call for that domain…

Given a brand's domain (or a direct URL to a shop/pricing page), returns a structured product catalog scraped from its website: for each…

Searches a content-analysis category taxonomy by name and returns up to 50 matching categories, each with its numeric category code, its…

Loads one page in a desktop browser and returns a link to a screenshot image of it, either the visible area or the full page, with the…

Takes no input and returns the full list of website technologies the technology index can detect, organised as technology groups (each with…

Given a domain, returns how many of its pages a backlink index lists, plus 1 or 100 of them in index order, each with its crawl record…

Given two domains, returns how many domains link to both of them, and the first 1 or 100 of those linking domains. For each of the two…

Given a search term, returns domains whose page HTML contains it, highest domain rank first: how many such domains the index holds, and 1…

Fetches the resource at a URL and returns its raw bytes as a base64 string, together with the content type the server reported and the size…

Given a URL, renders the whole page in a browser 1280 pixels wide and returns a full-page screenshot as a base64-encoded PNG inline in the…

Scans a website by URL and returns a GDPR compliance score and letter grade, plus the signals behind it: whether a cookie consent banner,…

Given a URL, follows every HTTP redirect hop to its final destination and returns the full chain: each hop's status code, status text,…

Given a domain, returns how many IP networks host sites that link to it, and the first 1 or 100 of those networks in index order. Each…

Given one or two domains and a start date, returns for each the number of new backlinks it gained and the number of backlinks it lost from…

Given one or two domains and a start date, returns for each how many new referring domains it gained and how many it lost from that date…

Crawls one page and returns an on-page SEO analysis: an overall on-page score, HTTP status, title, meta description and heading lists with…

Given a URL, returns an on-page SEO score plus the checks behind it: title and meta description length, heading structure, image alt-text…

Given the URL of a public product or app listing that shows ratings and reviews, returns the item's name, its average star rating, the…

Given a URL, determines whether the page is a product page and, when it is, returns a normalized product record: name, description, price,…

Given one or two domains, returns for each how many domains link to it and how many of those are counted as nofollow, plus the same two…

Downloads the file at a web address and returns it ready to inline: a complete data URI (media type plus base64 content in one string), the…

Given the URL of a public page that carries ratings and reviews for an item, returns the item's name (and its author, for a book), its…

Given a keyword, phrase or brand name, groups the web pages that cite it and carry a review rating into ten rating bands from 0 to 1. For…

Given a website's URL, fetches and parses its robots.txt file and returns the crawl rules for every user-agent it names (allowed and…

Given a domain (or an explicit sitemap URL), returns the list of URLs found in that site's sitemap, along with how many sitemap files were…

Given a domain name, returns its live SSL/TLS certificate details: whether it is currently valid, the issuer and subject, every alternate…

Given a starting URL and a JSON Schema you supply, crawls the site and returns one JSON object shaped exactly like your schema, filled in…

Given a technology name, returns up to 10 or 100 technologies found on websites that use it, all from the one technology group ranked first…

Given a domain, returns how many domains link to it and the top 30 or 100 of them by rank, highest first. Each referring domain carries its…

Given a domain, returns how many backlinks point to it, one per linking domain, and up to 60 or 100 of them by linking domain rank, highest…

Given one to three domains, returns the total number of backlinks pointing at each, with the domain each count belongs to and how many…

Given a URL, returns the page's main content converted to clean markdown -- navigation, ads, and other boilerplate stripped out -- along…

Given a technology name, returns US domains the index detected using it, highest domain rank first: how many such domains the index holds,…

Given a keyword, phrase or brand name, returns how many web pages in a content-analysis index cite it, plus the first 1 or 20 citing pages…

Takes no input and returns the fields a web content-analysis search accepts for filtering and sorting, each field name mapped to its value…

Given a URL, fetches the page and returns its text converted to Markdown with every link and image address removed, read from the first…

Given a URL and a plain-language request for what to pull out, renders the page with JavaScript and returns the requested data as JSON…

Fetches one web page and lists the links on it that point to a different host (a subdomain of the page's own host counts as different):…

Fetches a single URL and returns its rendered HTML along with page metadata (title, language, favicon, headings). Can strip chrome down to…

Fetches a single URL and returns every image asset found on the rendered page: each one's location (a linked URL or, for an inlined icon,…

Returns the readable main text of one public web page, given its URL: the page title, the page body as Markdown-style text with headings…

Given a web page's address, returns its main text as Markdown-style text (headings, lists and paragraphs, with links and markup removed),…

Given one web page URL, returns the page's main text as Markdown together with the requested and final (after redirects) addresses, the…

Fetches one page and returns its text split into header, footer and heading-based topics, each topic with its heading, level, language and…

Given a URL, fetches the page with a plain HTTP GET and HTML parse (no JavaScript rendering) and returns its plain-text content, page…

Fetches a URL, renders it like a browser (JavaScript included), and returns the page's content as clean Markdown -- ready to feed into…

Given two domains, returns how many web pages link to both, plus 1 or 100 of those pages in index order. For each page and domain, its…

Given a URL, returns the page's title, meta description, language, and robots directive, its Open Graph and Twitter Card text fields, and…

Given a website domain, returns its extracted design system: the accent/background/text color palette, heading and paragraph typography…

Given a domain or a direct page URL, detects which fonts a live web page uses, the HTML tags each one is applied to, roughly how much of…

Given a website address, returns up to 100 page URLs found on that site, each with the page's title and, for most pages, a short…

Given a domain or an exact URL, captures a rendered screenshot of that page (the landing page, a specific page type like pricing or login,…

Fetches a web page and grades its HTTP security headers from A to F with a 0-100 score. Lists each security header the page sends with its…

Given a website address, returns the page URLs the site lists in its published sitemaps, or the links found on the page itself when it…

Given a domain or URL, returns the technologies detected on that site's public HTTP headers and HTML (CDN, security headers, analytics,…

Takes no input and returns the fields four website-technology lookups accept for filtering and sorting (domains by technology, technology…

Given a domain, returns the technologies a website technology index detected on it, grouped by technology group and category (for example…

Given a URL, returns whether it is currently up or down, the HTTP status code and text, response latency in milliseconds, whether the…

Given the URL of an XML sitemap file, fetches and summarizes it: the sitemap's root type, the total number of URLs it lists, the most…