Merge output of two job in a single output file

[Anonymous]

Hi All,

How to merge two job output in a single output file.I am adding screenshot of my job:

I have to merge tFileOutputDelimited_3 and tFileOutputDelimited_4 out put in a single output file.Thanks in advance. 

[vapukov]

why just not append to first file?

[Anonymous]

Vinayak,

If the schema for both the files/flows are same you can use tUnite component to combine the result set.

In case of different schema, you could append the resultset.

In the first file remove "Throw an error if the file exist" in advanced setting of tFileOutputDelimited so the the file will be overwritten for every iteration. make sure "append" is unchecked in basic settings.

In the second file should be appended by checking "append" in basic settings.

Regards,

Ragu

[Anonymous]

How will we append that, will you please guide me or suggest me.

[Anonymous]

In tFileOutputDelimited_4,  go to basic settings then check (tick) the "Append" and make sure the

"File Name" is same for both tFileOutputDelimited_3. below is the screen shot.

[Anonymous]

Hi arragupathy,

As per your suggestion i have appended successfully. Now i got a output as a delimited file:

Now i have to generate a json file of it, like this:

Is there any way to achieve it, as this file having no schema define. Thanks in advance. 

[vapukov]

---

@vinayak019 wrote:

Hi arragupathy,

As per your suggestion i have appended successfully. Now i got a output as a delimited file:

Now i have to generate a json file of it, like this:

Is there any way to achieve it, as this file having no schema define. Thanks in advance. 

---

it possible to write java code for this

https://dzone.com/articles/how-to-convert-csv-to-json-in-java

https://stackoverflow.com/questions/19766266/directly-convert-csv-file-to-json-file-using-the-jackso...

or use something ready to use -

https://csvkit.readthedocs.io/en/1.0.3/ 

https://csvkit.readthedocs.io/en/1.0.3/scripts/csvjson.html?highlight=csvjson

[Anonymous]

Hi Vapukov,

I was using your suggested approach in https://community.talend.com/t5/Design-and-Development/need-to-convert-delimited-file-to-key-value-p... this.

So my job design like this:

I have replaced '|' delimited with ',', so input file is like that only:

 tFileInputDelimited_2 setting:

tJavaFlex_1 code:

now again, OnComponentOk, tFileInputDelimited_3 setting:

tjavaFlex_2 setting:

tJavaFlex_3 setting:

output of this job is:

Why it is creating json for first record only. my expectation is:

Where I am doing mistake, please let me know.

[vapukov]

think You are not read till the end of page 

find on page text about delimiter 🙂

[Anonymous]

Hi,

Will you please explain a little more, not getting it exactly.