How do I get more than 200 000 rows in a Data Query export?

Exports in a .csv format from Data Query are limited to 200 000 rows by default.

You can, however, subscribe to an option to increase the limit to 1 000 000 rows. If you are interested in this option, please contact your Account Manager.

You can circumvent the export limit by using the API instead of the export function.

Use the max-results and page-num parameters in the API URL. Set max-results to the maximum allowed number of rows (&max-results=10000 by default, 1000 with multiple periods, 30 with evolution) and increment the page number manually:

• 1^st API URL contains &page-num=1
• 2^nd API URL contains &page-num=2
• 3^rd API URL contains &page-num=3 
• And so forth.

If you don't want to do this manually you can automate this task using a script which will call all the results pages for your query.

Here are two articles which will help you with the automation:

• https://developers.atinternet-solutions.com/rest-api-en/response-structure-parameters-rest-en/page-num-parameter-rest-en/
• https://developers.atinternet-solutions.com/rest-api-en/methods-rest-en/getrowcount-rest-en/