topic Re: Incremental Import from HBASE to pipe delimiter text file in Talend Studio

Incremental Import from HBASE to pipe delimiter text file

gt0731 — Sat, 16 Nov 2024 09:04:20 GMT

Hi I already have historical data loaded on talend big data platform. From hbase/XML to pipe delimited text. Want to conduct Incremental import from HBASE/XML TO pipe delimited text file.

Q1: How do I design incremental import based on HBase date column in it. ? If yes, please brief on it.

Q2 What are the alternatives to conducting Incremental load in HBASE.

Any help appreciated on it?

Please advise on it

Re: Incremental Import from HBASE to pipe delimiter text file

Anonymous — Mon, 20 Nov 2017 07:38:16 GMT

Hi,

You can use a tHBaseInput component to read the data from the Hbase table.TalendHelpCenter:tHBaseInput

Is there a timestamp field in your table?

Best regards

Sabrina

Re: Incremental Import from HBASE to pipe delimiter text file

gt0731 — Mon, 20 Nov 2017 07:45:26 GMT

Yes, we have timestamp column for it.
can you please let us know how to use a timestamp in HBase INPUT
Component. please guide?

Do we need to conduct any setting for doing incremental read before to
going for talend job configuration?