[ERROR] Run Talend Spark Batch on EMR Cluster

[jbechchar1617004469]

Hello,

I try to run a spark talend job on my EMR cluster but i have an error :

java.io.FileNotFoundException: File file:/root/.sparkStaging/application_1622724789583_0008/hadoop-yarn-server-common-2.8.3-amzn-1.jar does not exist

However, before in the log i see this

"file:/opthadoop-yarn-server-common-2.8.3-amzn-1.jar/talend/7.1.1/TalendJobServersFiles/cache/lib/2992436215_1293881007/ -> file:/root/.sparkStaging/application_1622724789583_0008/hadoop-yarn-server-common-2.8.3-amzn-1.jar"

No error with the upload

Someone can help me ?

Thanks in advance

[Anonymous]

Hello,

Please make sure the file "hadoop-yarn-server-common-2.8.3-amzn-1.jar " exists and is accessible.

Did you add tHDFSConfiguration in your spark job?

Best regards

Sabrina