while loading data from hadoop to hive getting extra records

RAJ6 — Sat, 16 Nov 2024 06:44:04 GMT

Hi Folks,

I am working in talend big data using one month license package. In this package there is no tHiveOutput component. so am using tHiveLoad component in my talend job for data loading from hadoop to hive.

I am getting data from Mssql then loaded into hadoop layer using text file format, then loaded data from hadoop to hive. This is talend job flow.

I have facing issue while loading data from hadoop to hive getting extra records. In tHDFSOutput component using field separator tilde(~) symbol and row separator \n. In tHiveLoad component also using field separator tilde(~) symbol and row separator \n. I have tried lot methods unable to find the solution for this issue.

Kindly share information as soon as earliest.

for example :

Mssql table count : 1000

Hive table count : 1010

Re: while loading data from hadoop to hive getting extra records

RAJ6 — Thu, 31 Jan 2019 05:41:24 GMT

Hi folks,
Kindly share your information for this issue.

topic Re: while loading data from hadoop to hive getting extra records in Talend Studio

while loading data from hadoop to hive getting extra records

Re: while loading data from hadoop to hive getting extra records