DCAT / data.json feeds
Crawl DCAT-US feeds like data.json to discover many datasets.
What it supports
data.json(DCAT-US) feeds- Example:
https://catalog.data.faa.gov/data.json
- Example:
How it works
- Downloads the feed
- Iterates dataset records
- Stores the landing URL and metadata
Tips
- DCAT feeds can be large.
- Use lower maxRequestsPerRun if you want shorter test runs.