topic Parsing JSON Data from a series of REST calls in Talend Studio

Parsing JSON Data from a series of REST calls

dan-rosen — Wed, 08 Apr 2020 20:51:20 GMT

Hello,

I am trying to build a job that can make a series of HTTP requests using the REST client to a dynamic list of endpoints and return that data in usable JSON format.

I have a list of employee numbers, and the endpoints I need to hit are different for each employee number. I have been able to iterate over a series of values and log out the response for each of these requests, and the data seems right, but they all come back as separate responses.

Would anyone be able to explain how to set this up so that the data from the different responses can become one single data file?

Thanks in advance!

Re: Parsing JSON Data from a series of REST calls

Anonymous — Wed, 15 Apr 2020 08:02:32 GMT

Extract data from each response using tExtractJsonField and store them into memory using tHashOutput. In next subjob, read all data from memory using tHashInput, re-write a Json string and output it to a file.

Regards
Shong

Re: Parsing JSON Data from a series of REST calls

dan-rosen — Wed, 15 Apr 2020 12:10:36 GMT

Thanks Shong, that's a good suggestion. I was actually able to solve my issue by writing the data to a database in each iteration (or alternatively storing in a temp file), but it sounds like your solution will work better in a job that requires work to be done on this combined data set, so I will give that a shot at some point as well.