topic Re: KAFKA to HBase in Talend Studio

KAFKA to HBase

RP1629548713 — Fri, 15 Nov 2024 23:49:31 GMT

Hi ,

I want to load data into HBase table from Kafka.

I have used the following components : tKafkaInput->tmap->tHbaseoutput.

Is this the correct way of doing it? If not please help, can someone share the design of their job if made for the same?

Re: KAFKA to HBase

RP1629548713 — Thu, 26 Aug 2021 03:19:04 GMT

Hi @Chaillou Chaillou @Shicong Hong

Can you please help on the same.

Is there anyway to split the incoming Kafka input within the string of single column to multiple rows ?

Please suggest

Re: KAFKA to HBase

Anonymous — Tue, 31 Aug 2021 06:33:20 GMT

Hello,

With your requirement "split the incoming Kafka input within the string of single column to multiple rows", could you please elaborate your case with an example with input and expected output values?

Best regards

Sabrina

Re: KAFKA to HBase

RP1629548713 — Tue, 31 Aug 2021 18:17:55 GMT

Hi Sabrina,

I am trying to load Kafka topic into a Hbase table.

When I use a tkafkainput I get a predefined schema to it.

I am currently taking the Kafka input and then storing the messages in staging file and loading it to target.

But I don't think this approach is feasible as the data will be a streaming output it will always keep appending then in the case how will I load that staging file in Hbase? Is there any other way to do this? Can I skip this staging file and directly feed Kafka input to HBase columns as the issue pertains due to schema difference as Kafka input has inbuilt one and target should have columns and rows.

please help as I am pretty new to kafka

Re: KAFKA to HBase

Anonymous — Wed, 01 Sep 2021 08:18:32 GMT

Hello,

There is direct connection to HBase. What's talend solution are you using?

tHBaseConnection component in this framework is available in all Talend products with Big Data and in Talend Data Fabric

Best regards

Sabrina

Re: KAFKA to HBase

RP1629548713 — Wed, 01 Sep 2021 18:21:25 GMT

Yes I am using data Fabric.

Sabrina, basically we want to take a Kafka topic read the input and load it into Hbase . Such that we want to perform updates on Hbase table.

Can you please help me with the design flow of this?