https://community.qlik.com/t5/Talend-Studio/java-io-FileNotFoundException-spark-job-on-HDP/m-p/2293745#M66687 <P>Failure on executing spark job in HDP 2.5 sandbox. Job is submitted to Yarn and getting failed with below error tried changing <B>spark "scratch" directory</B> but no luck. </P><P>Is there any way to override c: or skip.</P><P>According to <A href="https://help.talend.com/reader/PJjYRkeHQCiEoH8eIxqbCw/R16fQAWCPE5UGCJK7~LOYA" target="_blank">https://help.talend.com/reader/PJjYRkeHQCiEoH8eIxqbCw/R16fQAWCPE5UGCJK7~LOYA</A> default is c: without modification. </P><P></P><P></P><P>Application application_1600700049240_0026 failed 2 times due to AM Container for appattempt_1600700049240_0026_000002 exited with exitCode: -1000</P><P>For more detailed output, check the application tracking page: <A href="http://sandbox.hortonworks.com:8088/cluster/app/application_1600700049240_0026" target="_blank">http://sandbox.hortonworks.com:8088/cluster/app/application_1600700049240_0026</A> Then click on links to logs of each attempt.</P><P>Diagnostics: File file:/C:/tmp/spark-eeaf58bf-c0e4-4a95-b87c-2564d59c0609/__spark_conf__2267956587040359783.zip does not exist</P><P>java.io.FileNotFoundException: File file:/C:/tmp/spark-eeaf58bf-c0e4-4a95-b87c-2564d59c0609/__spark_conf__2267956587040359783.zip does not exist</P><P>at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:624)</P><P>at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:850)</P> Sat, 16 Nov 2024 01:25:22 GMT Hemant4 2024-11-16T01:25:22Z https://community.qlik.com/t5/Talend-Studio/java-io-FileNotFoundException-spark-job-on-HDP/m-p/2293745#M66687 <P>Failure on executing spark job in HDP 2.5 sandbox. Job is submitted to Yarn and getting failed with below error tried changing <B>spark "scratch" directory</B> but no luck. </P><P>Is there any way to override c: or skip.</P><P>According to <A href="https://help.talend.com/reader/PJjYRkeHQCiEoH8eIxqbCw/R16fQAWCPE5UGCJK7~LOYA" target="_blank">https://help.talend.com/reader/PJjYRkeHQCiEoH8eIxqbCw/R16fQAWCPE5UGCJK7~LOYA</A> default is c: without modification. </P><P></P><P></P><P>Application application_1600700049240_0026 failed 2 times due to AM Container for appattempt_1600700049240_0026_000002 exited with exitCode: -1000</P><P>For more detailed output, check the application tracking page: <A href="http://sandbox.hortonworks.com:8088/cluster/app/application_1600700049240_0026" target="_blank">http://sandbox.hortonworks.com:8088/cluster/app/application_1600700049240_0026</A> Then click on links to logs of each attempt.</P><P>Diagnostics: File file:/C:/tmp/spark-eeaf58bf-c0e4-4a95-b87c-2564d59c0609/__spark_conf__2267956587040359783.zip does not exist</P><P>java.io.FileNotFoundException: File file:/C:/tmp/spark-eeaf58bf-c0e4-4a95-b87c-2564d59c0609/__spark_conf__2267956587040359783.zip does not exist</P><P>at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:624)</P><P>at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:850)</P> Sat, 16 Nov 2024 01:25:22 GMT https://community.qlik.com/t5/Talend-Studio/java-io-FileNotFoundException-spark-job-on-HDP/m-p/2293745#M66687 Hemant4 2024-11-16T01:25:22Z