1. Default mode: searches articles crawled in the last six months using an Elastic Search cache to minimize response time and return recently crawled data only.
2. searchArchives mode: searches Article data sorted by date crawled at any time over the last 2+ years.

To enable a search of the archives when sorting by publication date, add &searchArchives=1 to your API call, i.e. https://kg.diffbot.com/kg/v3/dqltoken=YOUR_TOKEN&type=query&size=1&query=type%3AArticle+author%3A"Jerome+Choo"+sortBy%3Adate&searchArchive=1

API Response Excerpt:

"request": {
    "pageUrl": "https://www.alwihdainfo.com/sitemap-posts.xml",
    "api": "analyze",
    "fields": "allLinks",
    "version": 3
},
"humanLanguage": "fr",
"allLinks": [
    "https://www.alwihdainfo.com/hainan-free-trade-port-a-growth-engine-not-a-tax-haven/",
    "https://www.alwihdainfo.com/chinas-zero-tariff-policy-for-africa-a-development-opportunity-amid-western-concerns/",
...

Usage To use this parameter, simply append noredirects to your API call URL.

Example Request: https://api.diffbot.com/v3/analyze/?token=YOUR_TOKEN&url=ARTICLE_URL&noredirects

Error Handling When the noredirects parameter is used, the API will not follow a redirect. Instead, if a redirect is required to access the page content, the API will return an HTTP 500 Internal Server Error with a specific JSON response body. The final, redirected URL is not included in the response.

Example Error Response (HTTP 500):

{
  "errorCode": 500,
  "error": "This page requires a redirect. Please retry with redirects enabled if this url needs to be extracted."
}

Primary Use Cases & Benefits This parameter is most beneficial when using specific extraction APIs, such as the Article API or Product API, rather than the Diffbot Analyze API. Use it to:

• Prevent extractions: for example, use this param to prevent an outdated article or product offer URL from silently redirecting to a general index or homepage when the original content is no longer available. This avoids the undesired extraction of the first item from a list on the index page.
• Control the extraction source: to ensure that the extraction is performed only on the exact URL submitted, giving developers certainty regarding the data source.

We will be updating Organization.naceClassification to NACE Rev. 2.1 in build v437 of the Diffbot Knowledge Graph, targeted to go live in about two weeks. Please read on for more details.

Ordinarily, we take extraordinary measures to avoid breaking changes in the Diffbot Knowledge Graph ontologies. However, in some cases, there is no benefit in retaining a prior version of the data, so we replace an existing attribute with a new data format. The Organization.naceClassification field is one such case. The current version of the NACE codes in the KG lacks level, isPrimary, and ancestor codes. And, some of the codes are no longer valid in the latest NACE Rev. 2.1 version.

In Rev 2.1 of the NACE codes:

• NACE codes are no longer strictly 4-digit numbers.
• NACE codes are structured into:
      Sections (letters A–V, level 1) →
 Divisions (2 digits, level 2) →
      Groups (3 digits with dot, level 3) →
 Classes (4 digits with dot, level 4).
• Codes are unique. For example, both 28 and 29 share the same parent C, but it is not repeated after 28 because it already appears earlier in the primary chain.
• There is at most one primary code per level.
• Primary codes are listed before non-primaries.
• Specific codes (e.g., 29.10) are listed before broader ones (e.g., 29.1).

For a comparison of the existing code format versus the new Rev 2.1 format, see below.

CURRENT DATA FORMAT: NACE codes - Organization.naceClassification

Volkswagen's current NACE classification in the KG appears as the following

[  
  {  
    "code": "2910",  
    "isPrimary": false,  
    "name": "Manufacture of motor vehicles"  
  },  
  {  
    "code": "7022",  
    "isPrimary": false,  
    "name": "Business and other management consultancy activities"  
  },  
  {  
    "code": "7021",  
    "isPrimary": false,  
    "name": "Public relations and communication activities"  
  }  
]

Issues with this data:

• Missing level information
• All codes are marked as non-primary
• Parent codes are missing
• Codes 7022 and 7021 are no longer valid in the Rev. 2.1 version of the codes
• Volkswagen should not be classified under those industries in 7022 and 7021.

NEW DATA FORMAT: NACE Rev 2.1 Codes

When the updates deploy, Volkswagen's Organization.naceClassification NACE codes will look like this:

[  
  {  
    "code": "29.10",  
    "level": 4,  
    "isPrimary": true,  
    "name": "Manufacture of motor vehicles",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "29.1",  
    "level": 3,  
    "isPrimary": true,  
    "name": "Manufacture of motor vehicles",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "29",  
    "level": 2,  
    "isPrimary": true,  
    "name": "Manufacture of motor vehicles, trailers and semi-trailers",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "C",  
    "level": 1,  
    "isPrimary": true,  
    "name": "MANUFACTURING",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "28.11",  
    "level": 4,  
    "isPrimary": false,  
    "name": "Manufacture of engines and turbines, except aircraft, vehicle and cycle engines",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "28.1",  
    "level": 3,  
    "isPrimary": false,  
    "name": "Manufacture of general-purpose machinery",  
    "version": "Rev 2.1"  
  },  
  {  
    "code": "28",  
    "level": 2,  
    "isPrimary": false,  
    "name": "Manufacture of machinery and equipment n.e.c.",  
    "version": "Rev 2.1"  
  }  
]

Khuyen Tran and Bex Tuychiev also wrote up a great getting started guide you can follow.

Postman is an API testing platform that eliminates the need to manually write cURL. The API testing UI is quite similar to what we have in the docs, with even more features to setup your environment, testing scripts, and more.

Note that our primary documentation platform will continue to live on docs.diffbot.com. Postman is an extension of our docs presence to make it easier for Postman users to test Diffbot APIs on their preferred platform.

Fork and watch our Diffbot API collection on Postman!

The report types we support include Current Reports, Quarterly Reports, Annual Reports, and more . Please let us know if there are reports you'd like us to add to the graph.

https://kg.diffbot.com/kg/v3/dql?type=query&token=TOKEN&query=type%3AOrganization+types%3A%22Company%22&size=25&filter=id%20name%20homepageUri

But this approach can be unwieldy if you have a long list of attributes to include or if you only want to exclude a few attributes per entity in the output.

Now, instead of specifying the fields you want to include, you can exclude fields you do not want returned when exporting data by using the &filterExclude= param (i.e. &filterExclude=subsidiaries%20technologies%20customers)

https://kg.diffbot.com/kg/v3/dql?type=query&token=TOKEN&query=type%3AOrganization+types%3A%22Company%22&size=25&filterExclude=subsidiaries%20technologies%20customers

Usage Analytics are still available via the Account API and via the Diffbot Dashboard.

You can view a sample acquisition record here: https://app.diffbot.com/entity/Ezw5giKVqNZmMQ7DI97txyg

To test this idea, we fine-tuned LLama 3.3 70B to be an expert tool user of a real-time Knowledge Graph API, providing the first open-source implementation of a GraphRAG system that outperforms Google Gemini and ChatGPT. To learn more, see: https://github.com/diffbot/diffbot-llm-inference/.

• SEC Filings
• Documents found on a company’s website, like earnings call transcripts, annual reports, ESG reports, etc.

Initial coverage focuses on the top 1000, publicly-traded companies in the United States.

The Diffbot DevOps team will be using this time to upgrade some of the underlying infrastructure supporting global crawls. To ensure the rapid restoration of uptime and stability of the platform, we are performing this upgrade during ordinary business hours.

During this maintenance window, all updates to the Diffbot Knowledge Graph will be paused. Access to Organization and Person data will continue. Access to Article data will be limited, i.e. you will not be able to download new article data from the graph for your sources, nor will you be able to access article data crawled more than 5 months ago. All other graph data types, including Products & Events, will be inaccessible.

Other Diffbot services will continue to be operational including Crawlbot, all Extraction APIs, the Bulk Extract API, the Natural Language API, and the Enhance APIs.

• Added categories for events
• Improved rule handling for event location, date, title, and description.
• Improved title, image, start & end date, and timezone extraction.
• Added support for extraction of location from maps as well as text.

Monitor key business events like

New Products
Partnerships
Mergers & Acquisitions
Executive Hires
Funding
Private Equity
Layoffs

For more personalized monitoring, you can also curate keyword and company lists. Unlike Diffbot APIs, LeadGraph is accessible via trial, only, for now. Reach out to us for access.

Use the NL API to build Knowledge Graphs from large corpora, or highly personalized news monitoring pipelines.

And starting right now, you can explore the Natural Language API in the dashboard without code. Give it a go at https://app.diffbot.com/natural-language/

What's included in the free plan?

• Access to Extract, Knowledge Graph (DQL & Enhance), and Natural Language Processing
• 10,000 monthly credits
• API and Dashboard access

To get started, sign up for an account here.

Your first clue — "The Easter Bunny was first mentioned in an essay by this German physician."

Notes:

• Searching on the dashboard does not consume credits
• Sign up for a fresh trial if your trial has expired

See the NL API summarization demo here.

The changes are described here: https://docs.diffbot.com/reference/bulkjobstatus
*Please note that this change DOES NOT affect the behavior of bulkjob results - only the coverage report.

FIRST:

The 'types' array was sorted with the most specific type first. We reversed the order to make the array consistent with 'types' in Organization, Person, and Place entities in the graph.

SECOND:
The 'types' array currently always contains GlobalIndexDiffbotEntity for Articles/Job Posts/Discussions/Product Offers. We have removed that unnecessary 'types' designation, i.e.

"types": [
"Article",
"GlobalIndexDiffbotEntity"
]

became

"types": [
"Article"
]

similar to

"types": [
"Organization",
"Corporation",
"Company"
]

FINALLY:
Some 'types' arrays previously contained GlobalIndexComplexTypeWrapper as well. We removed that unnecessary 'types' designation, i.e.

"types": [
"Discussion",
"GlobalIndexComplexTypeWrapper",
"GlobalIndexDiffbotEntity"
]

became

"types": [
"Discussion"
]

We care deeply about your privacy. Recently, we discontinued all advertising, cookie, and web beacon-based tracking on www.diffbot.com. Instead, we use Plausible Analytics for Visitor analytics and website reporting. Please note: Trial Users & Subscribers who create an account with Diffbot are still required to accept cookies to use the Diffbot Dashboard or Leadgraph web applications.

While we've discontinued advertising, we do plan to continue to send the occasional marketing newsletter to update you on recent product launches and programs. Want to change how you receive these emails? You can update your preferences or unsubscribe from the list by contacting us at privacy@diffbot.com or by clicking the 'unsubscribe' link in the footer of the newsletter.

Major additions to the Diffbot Privacy Policy include:

• a supplemental Privacy Policy for CA Residents that can be found here.
• a supplemental Privacy Policy for EEU Residents that can be found here. Please Note: a section of this policy is dedicated to individuals residing in the European Economic Area (EEA), the UK, and Switzerland.

These additions expand the protections and rights of Users under the California Privacy Rights Act, Cal. Civ. Code §§ 1798.100 et seq. (“CPRA”), EU Data Protection Laws, other laws of the European Union or any Member State thereof, the UK GDPR, and the laws of any other country or state to which you may be subject.

Major edits made to and removals from the policy and additional terms include:

• an updated list of subprocessors [most notably we added Plausible Analytics and removed all third parties supporting advertising services],
• an updated Cookie Policy,
• an updated DPA [contact privacy@diffbot.com to execute the April 2023 DPA or to amend a DPA we already have on file with your organization], and
• clarification of data collected from Visitors vs. Trial Users vs. Subscribers.

• Turn off natural language processing to provide sentiment analysis (natural language processing adds the most time to an on-demand extraction call)

  &nl=false

• Many publishers of articles provide text without having to render the page. If you need full HTML outputs for each page, you will not want to use this argument.

  &norender

Example or Search

Added support for non-software technologies such as:

• type:Organization technographics.technology.name:"3D food printing" and
• type:Technology technologyCategories:"Manufacturing"

Added new organization industries to the graph including:

• Real Estate > Real Estate Investment Trusts (naics: 525930)
• Financial Services > Banks > Central Banks (naics: 521110)
• Financial Services > Credit Unions (naics: 522130)
• Financial Services > Money Exchange Providers (to include Foreign exchange companies, and Online remittance providers)
• Services > Laundry Companies (naics: 812320)
• Food > Dairy Companies (naics: 112120)
• Food > Cocoa Companies (naics: 311351)
• Medical Organizations > Cannabis Companies
• Construction Companies > Landscaping Services (naics: 561730)
• Environmental Organizations > Recyclable Material Companies (naics: 423930) (we separated Waste Organizations And Recycling Facilities into "Waste Organizations" and "Recyclable Material Companies")
• Consumer Service Companies > Parking Companies (naics: 812930)
• Hospitality Companies > Adult Entertainment Clubs
• Retailers > Vending machine operators (naics: 454210)
• Retailers > Used Merchandise Retailers (naics: 459510)
• Educational Organizations > | Educational Institutions > K12 Schools (to check the differences with Schools and clean in case)

Added Organization.employeeCategories
Organizations with a particular number of people in a department (e.g., sales)