while loading data from hadoop to hive getting extra records
Hi Folks,
I am working in talend big data using one month license package. In this package there is no tHiveOutput component. so am using tHiveLoad component in my talend job for data loading from hadoop to hive.
I am getting data from Mssql then loaded into hadoop layer using text file format, then loaded data from hadoop to hive. This is talend job flow.
I have facing issue while loading data from hadoop to hive getting extra records. In tHDFSOutput component using field separator tilde(~) symbol and row separator \n. IntHiveLoad component also using field separator tilde(~) symbol and row separator \n. I have tried lot methods unable to find the solution for this issue.