Skip to content

Extract Links from a Sitemap

Diffbot API now supports link extraction from an xml sitemap using the Analyze API and the 'fields=allLinks' param. Sample API Call: https://api.diffbot.com/v3/analyze?url=https://www.alwihdainfo.com/sitemap-posts.xml&fields=allLinks&token=YOUR-TOKEN

API Response Excerpt:

"request": {
    "pageUrl": "https://www.alwihdainfo.com/sitemap-posts.xml",
    "api": "analyze",
    "fields": "allLinks",
    "version": 3
},
"humanLanguage": "fr",
"allLinks": [
    "https://www.alwihdainfo.com/hainan-free-trade-port-a-growth-engine-not-a-tax-haven/",
    "https://www.alwihdainfo.com/chinas-zero-tariff-policy-for-africa-a-development-opportunity-amid-western-concerns/",
...