Loading data from OracleXE DB to Impala (Cloudera 5.13) takes too long and writes too slow (pic)

pale16 — Sat, 16 Nov 2024 00:10:15 GMT

Hi, i'm trying to load data from XE db to Impala which is on Cloudera Quickstart 5.13 but it takes too much time.

And write is way too slow and gives error.

Is this good way to load data into Impala anyway?

I'm new to Talend Big Data so any advice is a plus 🙂

Output Log:

Starting job source_data_load_2_impala at 00:10 08/05/2021.

[statistics] connecting to socket on port 4036

[statistics] connected

Exception in the component tImpalaOutput_1:org.apache.thrift.transport.TTransportExceptionException in the component tImpalaOutput_1:org.apache.thrift.transport.TTransportExceptionException in the component tImpalaOutput_1:org.apache.thrift.transport.TTransportException

2148622 milliseconds

[statistics] disconnected

Job source_data_load_2_impala ended at 00:46 08/05/2021. [Exit code = 0]

Re: Loading data from OracleXE DB to Impala (Cloudera 5.13) takes too long and writes too slow (pic)

Anonymous — Wed, 09 Mar 2022 11:29:40 GMT

Hello @Filip Paležac ,

I checked in your Impala component and you are using "Hive driver". Can you please change it to "Impala" in the component and then share your observations?

Thanks

topic Re: Loading data from OracleXE DB to Impala (Cloudera 5.13) takes too long and writes too slow (pic) in Talend Studio

Loading data from OracleXE DB to Impala (Cloudera 5.13) takes too long and writes too slow (pic)

Re: Loading data from OracleXE DB to Impala (Cloudera 5.13) takes too long and writes too slow (pic)