Each post in an Archive dataset includes the same rich fields as live data.
| Field | Description |
|---|---|
uuid | Unique post ID. |
url | Post URL. |
title | Post title. |
text | Full post text. |
author | Author name. |
published | Publish date. |
crawled | Crawl date. |
language | Detected language. |
ord_in_thread | Position of the post within its thread. |
external_links | Outbound links found in the post. |
thread | Site metadata: site, site_full, site_type, country, domain_rank, site_categories, replies_count, participants_count, main_image, social, and more. |
entities | Detected persons, organizations, and locations - each with name and per-entity sentiment. |
These open web fields are not available in Archive: document-level sentiment, category, topic, trust object, breaking news, num_chars, webz_reporter, ai_allow, and has_canonical.
