I am new to ElasticSearch
I have connected to ElasticSeach and have been able to retrieve the first 10,000 records. I then started looking at the pagination settings to get it to bring back multiple sets of 10,000 records, but when I attempt this I get the total number of records back in the form of the first 10,000 over and over.
I am unsure as to which setting I should be using. I tried Offset, but was unable to find the offset and limit headers within the structure. I then looked the Next URL and Token options. Again nothing.
I am contemplating writing a custom script using a for loop, but I have seen some posts of people failing to get this working.
The question is, should I be using Offset, Next URL, Next Token options or is my only option to attempt a custom script?
This is the structure of what I get returned
and then source being all the data fields.
Any help or examples would be grateful.