Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
See why IDC MarketScape names Qlik a 2025 Leader! Read more
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Connecting to MapR Hadoop DFS

Hi,
I've created a data integration job to connect to MapR distribution as following,
1. Create tHDFSConnection (Big Data -> tHDFSConnection)
=> Hadoop version = MapR
=> URI "maprfs:///:9000/"
=> Username "hadoop"
=> Group "hadoop"
2. Running this job was working fine and closed.
3. Added tHDFSGet (Big Data -> tHDFSGet)
=> Use an existing connection: Selected tHDFSConnection_1 created in step#1
=> HDFS Directory "vz/" (It is available in my hadoop setup)
=> Local Directory "D:/ETL/AWS-MapR-TOS"
--- Run Details ---
Starting job demo at 14:16 06/08/2012.

connecting to socket on port 4059
connected
java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path
at java.lang.ClassLoader.loadLibrary(Unknown Source)
...
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:115)
at verizontest.demo_0_1.demo.tHDFSGet_1Process(demo.java:363)
at verizontest.demo_0_1.demo.runJobInTOS(demo.java:737)
disconnected
at verizontest.demo_0_1.demo.main(demo.java:592)
Unable to load libMapRClient.so native library
Exception in thread "main" java.lang.Error: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path
at verizontest.demo_0_1.demo.tHDFSGet_1Process(demo.java:546)
at verizontest.demo_0_1.demo.runJobInTOS(demo.java:737)
at verizontest.demo_0_1.demo.main(demo.java:592)
Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path
at java.lang.ClassLoader.loadLibrary(Unknown Source)
at java.lang.Runtime.loadLibrary0(Unknown Source)
...
...
at verizontest.demo_0_1.demo.tHDFSGet_1Process(demo.java:363)
... 2 more
Job demo ended at 14:16 06/08/2012.
Please let me know the inputs to resolve this and able to connect to MapR instance. Thanks.

Labels (4)
12 Replies
Anonymous
Not applicable
Author

Hi sabrina,

 

I have Mapr fs connection running successfully wiht above setup.But while settin gup that connection it asked for a jar file Protobuf 2.6 .jar version .So tht time we have used the tlibraryload component to make the conenction successful.But now to make this ocnnection enabled in metadata it is throwing the same error .So how can i let talend knw about this Jar to load it automatically as i have to use this metadataconnection further on in my many jobs

Anonymous
Not applicable
Author

Hello,

Could you please indicate on which talend build version you are using?

Best regards

Sabrina

Anonymous
Not applicable
Author

I am on talend 6.3 enterprise version