topic Insert JSON in kafka using tKafkaOutput in Talend Studio

Insert JSON in kafka using tKafkaOutput

Anonymous — Sat, 16 Nov 2024 10:20:45 GMT

Hello,
I have a csv file as follows:
id,first_name,last_name,email
1,x,x,x@x.com
2,y,y,y@y.com
I want to convert this to json object as follows
{
"id" : 1,
"first_name" : "x",
"last_name" : "x",
"email" : "x@x.com",
}
{
"id" : 2,
"first_name" : "y",
"last_name" : "y",
"email" : "y@y.com",
}
and now insert this each json object in kafka.
Thanks.

Re: Insert JSON in kafka using tKafkaOutput

vapukov — Tue, 04 Oct 2016 14:51:02 GMT

Hi,
simple answer - see attachments, somewhere in a middle You can add transformation CSV to JSON
using tWriteJSONFileds + convert data to byte[] (in example it .getByte() )

Re: Insert JSON in kafka using tKafkaOutput

Anonymous — Wed, 05 Oct 2016 06:39:33 GMT

Hello ,
Can you give me example for tFileInputDelimited -> tWriteJSONField
I tried it but getting error

I think I am doing wrong here for configure JSON tree.

Re: Insert JSON in kafka using tKafkaOutput

Anonymous — Wed, 05 Oct 2016 07:24:04 GMT

Solved thanks.
You saved me.
I used tJavaRow instead of tFixedFlowInput.

Re: Insert JSON in kafka using tKafkaOutput

Anonymous — Wed, 05 Oct 2016 10:42:19 GMT

Hello,
How can a pass the entire row from the file as it is , to kafka.
I am not understanding how i will convert the entire row to Bytes , This time I dont want it as JSON.
I want to send it to kafka as it in the raw file.
Thank you

Re: Insert JSON in kafka using tKafkaOutput

vapukov — Wed, 05 Oct 2016 23:52:15 GMT

Use tFileInputFullRow, with schema - single column - line