Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
RAJ6
Contributor III
Contributor III

while loading data from hadoop to hive getting extra records

Hi Folks,

 

I am working in talend big data using one month license package. In this package there is no tHiveOutput component. so am using tHiveLoad component in my talend job for data loading from hadoop to hive.

I am getting data from Mssql then loaded into hadoop layer using text file format, then loaded data from hadoop to hive. This is talend job flow.

I have facing issue while loading data from hadoop to hive getting extra records. In tHDFSOutput component using field separator tilde(~) symbol and row separator \n. In tHiveLoad component  also using field separator tilde(~) symbol and row separator \n. I have tried lot methods unable to find the solution for this issue. 

Kindly share information as soon as earliest. 

 

for example :

Mssql table count : 1000

Hive table count : 1010

Labels (3)
1 Reply
RAJ6
Contributor III
Contributor III
Author

Hi folks,
Kindly share your information for this issue.