Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
gt0731
Contributor III
Contributor III

How to stream log file from server into Hadoop ? Incrementally ?

We have server Log file data need to push into Hadoop using talend. 
We tried :
 regex pattern to directly load the server log data into hadoop
thdfsconnection
|
|
tfileinputregex -->thdfsoutput


But it did not work. As it is not outputting anything in target hadoop. Please suggest if we have alternate way to do this.

Attached is console output after job run :
ConsoleOutput.txt_20170219-0358.txt
Any help on it would be much appreciated .
Labels (2)
2 Replies
Anonymous
Not applicable

Hi,
For this error " Could not locate executable null\bin\winutils.exe  in the Hadoop binaries.", could you please take a look at this Kb article about: TalendHelpCenter:The missing winutils.exe program in the Big Data Jobs to see if this solution is OK with you.
Best regards
Sabrina 
gt0731
Contributor III
Contributor III
Author

Issue is i  have to Parse the Log data and Output Into HDFS.