Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Toronto Sept 9th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
RP1629548713
Contributor II
Contributor II

KAFKA to HBase

Hi ,

I want to load data into HBase table from Kafka.

I have used the following components : tKafkaInput->tmap->tHbaseoutput.

Is this the correct way of doing it? If not please help, can someone share the design of their job if made for the same?

Labels (4)
5 Replies
RP1629548713
Contributor II
Contributor II
Author

Hi @Chaillou Chaillou​ @Shicong Hong 

 

Can you please help on the same.

Is there anyway to split the incoming Kafka input within the string of single column to multiple rows ?​

Please suggest​

Anonymous
Not applicable

Hello,

With your requirement "split the incoming Kafka input within the string of single column to multiple rows", could you please elaborate your case with an example with input and expected output values?

Best regards

Sabrina

 

 

RP1629548713
Contributor II
Contributor II
Author

Hi Sabrina,​

I am trying to load Kafka topic into a Hbase table.

When I use a tkafkainput I get a predefined schema to it.

I am currently taking the Kafka input and then storing the messages in staging file and loading it to target.

But I don't think this approach is feasible as the data will be a streaming output it will always keep appending then in the case how will I load that staging file in Hbase? Is there any other way to do this? Can I skip this staging file and directly feed Kafka input to HBase columns as the issue pertains due to schema difference as Kafka input has inbuilt one and target should have columns and rows.

​please help as I am pretty new to kafka

Anonymous
Not applicable

Hello,

There is direct connection to HBase. What's talend solution are you using?

tHBaseConnection component in this framework is available in all Talend products with Big Data and in Talend Data Fabric

Best regards

Sabrina

RP1629548713
Contributor II
Contributor II
Author

Yes I am using data Fabric.

Sabrina, basically we want to take a Kafka topic read the input and load it into Hbase . Such that we want to perform updates on Hbase table.

Can you please help me with the design flow of this? ​