Attempted to seek or read past the end of the file in Talend Spark job

[Anonymous]

I am trying to convert an XML file to a CSV file. The job runs fine if i use HDFS as filesystem.

If i use S3 as file system the job fail with error Attempted to seek or read past the end of the file. If choose not have a header file the job runs fine even file being in S3. 

[Anonymous]

Hello,

There is not enough information for us to address your issue. Could you please also post your spark job design screenshots on forum?

Best regards

Sabrina

[Anonymous · Accepted solution]

i had to enable, s3a option in S3configuration component which resolved the issue.

[KarthikGs]

still not working for me,

java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.fs.s3a.S3AFileSystem

[Anonymous]

Hello @KarthikGs 

What's HDP version are you using in S3 components? On which talend big data build version you got this issue?

Let us know if this solution provided in jira issue helps.

https://jira.talendforge.org/browse/TBD-5232

Best regards

Sabrina