Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi ,
I want to load data into HBase table from Kafka.
I have used the following components : tKafkaInput->tmap->tHbaseoutput.
Is this the correct way of doing it? If not please help, can someone share the design of their job if made for the same?
Hi @Chaillou Chaillou @Shicong Hong
Can you please help on the same.
Is there anyway to split the incoming Kafka input within the string of single column to multiple rows ?
Please suggest
Hello,
With your requirement "split the incoming Kafka input within the string of single column to multiple rows", could you please elaborate your case with an example with input and expected output values?
Best regards
Sabrina
Hi Sabrina,
I am trying to load Kafka topic into a Hbase table.
When I use a tkafkainput I get a predefined schema to it.
I am currently taking the Kafka input and then storing the messages in staging file and loading it to target.
But I don't think this approach is feasible as the data will be a streaming output it will always keep appending then in the case how will I load that staging file in Hbase? Is there any other way to do this? Can I skip this staging file and directly feed Kafka input to HBase columns as the issue pertains due to schema difference as Kafka input has inbuilt one and target should have columns and rows.
please help as I am pretty new to kafka
Hello,
There is direct connection to HBase. What's talend solution are you using?
tHBaseConnection component in this framework is available in all Talend products with Big Data and in Talend Data Fabric
Best regards
Sabrina
Yes I am using data Fabric.
Sabrina, basically we want to take a Kafka topic read the input and load it into Hbase . Such that we want to perform updates on Hbase table.
Can you please help me with the design flow of this?