Extract Links from a Sitemap
Diffbot API now supports link extraction from an xml sitemap using the Analyze API and the 'fields=allLinks' param. Sample API Call: https://api.diffbot.com/v3/analyze?url=https://www.alwihdainfo.com/sitemap-posts.xml&fields=allLinks&token=YOUR-TOKEN
API Response Excerpt:
"request": {
"pageUrl": "https://www.alwihdainfo.com/sitemap-posts.xml",
"api": "analyze",
"fields": "allLinks",
"version": 3
},
"humanLanguage": "fr",
"allLinks": [
"https://www.alwihdainfo.com/hainan-free-trade-port-a-growth-engine-not-a-tax-haven/",
"https://www.alwihdainfo.com/chinas-zero-tariff-policy-for-africa-a-development-opportunity-amid-western-concerns/",
...