The self-serve Archive (Wizard and API) covers the last 5 years. For older data, Webz.io provides bulk data dumps - news back to 2008, blogs and discussions back to December 2014.
| Data type | Dumps available from |
|---|---|
| News | 2008 |
| Blogs | December 2014 |
| Discussions (forums) | December 2014 |
| Self-serve Archive | Data dumps | |
|---|---|---|
| Coverage | Last 5 years | News since 2008; blogs & discussions since December 2014 |
| Access | Query in the Wizard or API | Bulk, by request |
| Filtering | Filtered by your query | Whole months, unfiltered |
| Delivery | NDJSON ZIP, minutes to hours | ZIP of JSON from AWS Glacier |
Older data is less complete than recent data:
Because the data lives in AWS Glacier, dumps are provided on request rather than instantly. Contact [email protected] to request historical data dumps for the period you need.
AWS Glacier is cold storage, so restoring a dump takes longer than a standard Archive order.