This is important!To get the best value out of your data feeds do pay close attention to the paging and sorting sections following. See the Pagination tutorial for more information.
We suggest that you first get your filtered searches worked out using the playground, and then use them in a script.With the technicalities of pagination out of sight, you can concentrate on what is important - your data feeds!
Pagination: Collecting More than 100 Posts from a Query
Each request may return up to 100 posts matching your query. However, there may be significantly more results matching your filter parameters. To consume all the data, make sure you keep on calling the same URL string value that appears in the "next" key found in the output for each request.
JSON Output Example:
{
docs: [...],
totalResults: 7043729,
moreResultsAvailable: 7043629,
next: "//nseFilter?token=XXXXXXX-XXX-XXXX-XXXX-XXXXXXXXXXX&format=json&ts=1608216272000&q=%28article.language%3Aenglish+OR+language%3Afrench%29",
requestsLeft: 999932
}