Diffbot Help and Documentation

API Documentation

Analyze API

Determines the page-type for any given URL (and routes it to the appropriate extraction API, where applicable)

Article API

For structuring news articles, blog posts and other text-heavy pages

Discussion API

For discussion forums and message board threads

Image API

For extracting the primary images from pages

Product API

For structuring e-commerce product pages

Video API

For extracting metadata from video pages

Custom APIs

Custom data extraction from any site using manual rules

Bulk Processing

Asynchronous processing of many URLs using one of the above APIs

Crawlbot

For structuring entire sites using one of the above APIs

Search API

Realtime, field-specific search of your Crawlbot and Bulk API jobs