java.io.IOException: Invalid source or target

[Shafee]

Hi All,

When trying to use tOutputParquet component in Big data batch job getting this error: java.io.IOException: Invalid source or target

Below is the log:

[WARN ]: org.apache.spark.scheduler.TaskSetManager - Lost task 3.0 in stage 0.0 (TID 1, xyz.wellsfargo.com): java.io.IOException: Invalid source or target

[WARN ]: org.apache.spark.scheduler.TaskSetManager - Lost task 39.1 in stage 0.0 (TID 24, xyz.wellsfargo.com): com.mapr.fs.StaleFileException: close() on '/tmp/talend/u652162/sample/record/source_type = PB/workoutput/part-00039-m-00039.parquet' failed with error: Stale file handle (116).: retry? true

[ERROR]: org.apache.spark.scheduler.TaskSetManager - Task 2 in stage 0.0 failed 4 times; aborting job
[WARN ]: org.apache.spark.scheduler.TaskSetManager - Lost task 229.0 in stage 0.0 (TID 35, xyz.wellsfargo.com): java.lang.RuntimeException: org.apache.spark.TaskKilledException

Thanks in advance

[Anonymous]

Hi,

    The java exception says that either source or target details are invalid. Could you please verify whether the details given by you are correct? If the error persists, could you please share the job flow details along with component schema details (for the component where error is happening) for further analysis?

Warm Regards,

Nikhil Thampi