Iterating through a big csv file

[urend]

Hi there,

I have a CSV file with about 2,500 records. When I iterate through each one, I want to call about 5-10 API endpoint per record in the CSV file. What is the best way to do this, that will be the most efficient and quickest. I currently have it set up with no multiprocessing, but I believe I wouldn't be able to do that, as the API endpoints that check if a record exists, wouldn't be up to date, due to multiple records being worked on at any one point. Any ideas on the best way to solve this? Cheers

[Shicong_Hong]

Hello

Use the tFlowToIterate component to iterate over each record, and enable parallel execution, as shown bellow. 

Regards

Shicong