2024 Changelog
December 2024
Company Reports are now available in the KnowledgeGraph as type:CompanyReport, and in LeadGraph in company profiles. There are two primary types of reports available:
- SEC Filings
- Documents found on a company’s website, like earnings call transcripts, annual reports, ESG reports, etc.
Initial coverage focuses on the top 1000, publicly-traded companies in the United States.
November 2024
Please Note: there will be a scheduled maintenance window, including downtime for approximately 50 minutes, on Thursday, November 14th from 10 am PST until 2 pm PST.
The Diffbot DevOps team will be using this time to upgrade some of the underlying infrastructure supporting global crawls. To ensure the rapid restoration of uptime and stability of the platform, we are performing this upgrade during ordinary business hours.
During this maintenance window, all updates to the Diffbot Knowledge Graph will be paused. Access to Organization and Person data will continue. Access to Article data will be limited, i.e. you will not be able to download new article data from the graph for your sources, nor will you be able to access article data crawled more than 5 months ago. All other graph data types, including Products & Events, will be inaccessible.
Other Diffbot services will continue to be operational including Crawlbot, all Extraction APIs, the Bulk Extract API, the Natural Language API, and the Enhance APIs.
October 2024
We have —
- Added categories for events
- Improved rule handling for event location, date, title, and description.
- Improved title, image, start & end date, and timezone extraction.
- Added support for extraction of location from maps as well as text.
September 2024
News on LeadGraph is a new feature that allows anyone to monitor breaking news for key risk and opportunity signals.
Monitor key business events like
New Products
Partnerships
Mergers & Acquisitions
Executive Hires
Funding
Private Equity
LayoffsFor more personalized monitoring, you can also curate keyword and company lists. Unlike Diffbot APIs, LeadGraph is accessible via trial, only, for now. Reach out to us for access.
July 2024
In July, we worked on better normalization for videos in HTML5 along with enhanced support for video controls and audio elements in podcasts.
June 2024
Extract entities (e.g., people, organizations, products) and data about them (e.g., sentiment, relationships) from raw text. Try it via API (Introduction to Natural Language API) or the Dashboard: https://app.diffbot.com/natural-language/
May 2024
PLEASE NOTE: We plan to deprecate Organization.industries and Organization.diffbotClassification on Jan 7th, 2025. Instructions for how to migrate to the updated Organization.categories can be found here:
https://docs.diffbot.com/docs/industries-to-categories-migration-guideWe've made significant improvements to our industries classifier. This v2 classifier includes over 200 additional fine-grained categories of companies. While most of the existing categories are unchanged, you'll want to review the updated labels. The new industry taxonomy - now called Organization Categories - is documented here: https://docs.diffbot.com/docs/organization-industries
Did you know Diffbot has a Natural Language API? Not only is it capable of extracting entities but also the relationships between entities in any body of text.
Use the NL API to build Knowledge Graphs from large corpora, or highly personalized news monitoring pipelines.
And starting right now, you can explore the Natural Language API in the dashboard without code. Give it a go at https://app.diffbot.com/natural-language/
April 2024
We're excited to introduce a free plan for Diffbot. The free plan will replace our 2 week trial and include a generous helping of monthly credits for startups and hobbyists to get started without worrying about a monthly bill.
What's included in the free plan?
- Access to Extract, Knowledge Graph (DQL & Enhance), and Natural Language Processing
- 10,000 monthly credits
- API and Dashboard access
To get started, sign up for an account here.
March 2024
🐣 Each egg contains a clue to the next.
👀 Eggs are only visible in entities on the Dashboard (link in comment), not via API.
🔍 This is not school. Google/ChatGPT/query all you want.
🥇 First person to eggstract all 16 easter eggs will win a lifetime personal plan and the swaggiest Diffbot swag.Your first clue — "The Easter Bunny was first mentioned in an essay by this German physician."
Notes:
- Searching on the dashboard does not consume credits
- Sign up for a fresh trial if your trial has expired
February 2024
We've recently expanded coverage of 'secForms' back to 1994 (pre XBRL introduced in 2005). Over the coming weeks and months, you will see these data flowing into organization profiles. To view examples of secForms already in the graph search for organizations that have secForms (type:Organization has:secForms)
January 2024
We've added type:Research to the graph. Each entity is a journal article or research publication from a validated source. Data will continue to flow for the next month or so as we integrate all of the available metadata from OpenAlex.org. Future phases will combine OpenAlex metadata with the full text of the publication extracted from HTML or PDF (when it is publicly available to access) and will include data provenance and fair use details. Try a search for journal articles that include AI in the title: type:Research title:"AI" sortBy:date