Skip to main content
Announcements
July 15, NEW Customer Portal: Initial launch will improve how you submit Support Cases. IMPORTANT DETAILS
cancel
Showing results for 
Search instead for 
Did you mean: 
RAJ6
Contributor III
Contributor III

while loading data from hadoop to hive getting extra records

Hi Folks,

 

I am working in talend big data using one month license package. In this package there is no tHiveOutput component. so am using tHiveLoad component in my talend job for data loading from hadoop to hive.

I am getting data from Mssql then loaded into hadoop layer using text file format, then loaded data from hadoop to hive. This is talend job flow.

I have facing issue while loading data from hadoop to hive getting extra records. In tHDFSOutput component using field separator tilde(~) symbol and row separator \n. In tHiveLoad component  also using field separator tilde(~) symbol and row separator \n. I have tried lot methods unable to find the solution for this issue. 

Kindly share information as soon as earliest. 

 

for example :

Mssql table count : 1000

Hive table count : 1010

Labels (3)
1 Reply
RAJ6
Contributor III
Contributor III
Author

Hi folks,
Kindly share your information for this issue.