Changelog

June 2026

• June 15, 2026

  sortBy:date, Last six months vs. full archive

  There are two modes of searching Article data in the Diffbot KG when sorting by date:

  1. Default mode: searches articles crawled in the last six months using an Elastic Search cache to minimize response time and return recently crawled data only.
  2. searchArchives mode: searches Article data sorted by date crawled at any time over the last 2+ years.

  To enable a search of the archives when sorting by publication date, add &searchArchives=1 to your API call, i.e. https://kg.diffbot.com/kg/v3/dqltoken=YOUR_TOKEN&type=query&size=1&query=type%3AArticle+author%3A"Jerome+Choo"+sortBy%3Adate&searchArchive=1

May 2026

• May 6, 2026

  Extract Links from a Sitemap

  Diffbot API now supports link extraction from an xml sitemap using the Analyze API and the 'fields=allLinks' param. Sample API Call: https://api.diffbot.com/v3/analyze?url=https://www.alwihdainfo.com/sitemap-posts.xml&fields=allLinks&token=YOUR-TOKEN

  API Response Excerpt:

  "request": {
      "pageUrl": "https://www.alwihdainfo.com/sitemap-posts.xml",
      "api": "analyze",
      "fields": "allLinks",
      "version": 3
  },
  "humanLanguage": "fr",
  "allLinks": [
      "https://www.alwihdainfo.com/hainan-free-trade-port-a-growth-engine-not-a-tax-haven/",
      "https://www.alwihdainfo.com/chinas-zero-tariff-policy-for-africa-a-development-opportunity-amid-western-concerns/",
  ...

March 2026

• March 3, 2026

  Optional Param noredirects

  We have added support for the optional query parameter noredirects to the Diffbot API. This parameter prevents the Diffbot API from automatically following HTTP redirects for the submitted URL, giving you more control over the extraction process.

  Usage To use this parameter, simply append noredirects to your API call URL.

  Example Request: https://api.diffbot.com/v3/analyze/?token=YOUR_TOKEN&url=ARTICLE_URL&noredirects

  Error Handling When the noredirects parameter is used, the API will not follow a redirect. Instead, if a redirect is required to access the page content, the API will return an HTTP 500 Internal Server Error with a specific JSON response body. The final, redirected URL is not included in the response.

  Example Error Response (HTTP 500):

  {
    "errorCode": 500,
    "error": "This page requires a redirect. Please retry with redirects enabled if this url needs to be extracted."
  }

  Primary Use Cases & Benefits This parameter is most beneficial when using specific extraction APIs, such as the Article API or Product API, rather than the Diffbot Analyze API. Use it to:

  • Prevent extractions: for example, use this param to prevent an outdated article or product offer URL from silently redirecting to a general index or homepage when the original content is no longer available. This avoids the undesired extraction of the first item from a list on the index page.
  • Control the extraction source: to ensure that the extraction is performed only on the exact URL submitted, giving developers certainty regarding the data source.

January 2026

• January 7, 2026

  50 billion new facts Added to the KG in the last month

  50 billion new facts were added to the Diffbot Knowledge Graph in the last month, including 30M new organizations and 600M articles.

Archive

202620252024202320222021202020192018201720162015