how to stream from kafka topic (TkafkaInput) to a local file (TfileOutPutDelimted)

[Anonymous]

Hello,

I am trying to stream data from a kafka topic to a local file on my pc, but each time i run the map the file comes out as an empty file with no data in it.

is there's a specific way to do it ?? because i cant find the issue

All i want to do is to stream data from the topic to the local text file in real time.

here's my map and output file

and here is the output file , it is always empty

thanks and have a nice day.

[Anonymous]

Hi
Add a tLogRow before tFileOutputDelimited to print the result on the console to check if the data are read correctly from the kafka topic.

Regards
Shong

[priya_10]

I have similar requirement , message is printed correctly in log but not able to write in file

[ThomasLetellier]

I got the same issue, does anyone knows how to fix it ?

[Anonymous]

@thomas letellier​ , have a try to split the job to two steps, cache the message in memory and read them back in next subjob.

tkafkaInput--main--tHashOutput

|onsubjobok

tHashInput--main--tFileOutputDelimited

Let me know if it works.

Regards

Shong