converting xml to csv

[Anonymous]

Hi,

I want to convert 80 gb xml file to csv. Unfortunately I couldn't do it. Could data size be a problem? What should i do?

My file is located at following website:

https://archive.org/download/stackexchange/stackoverflow.com-Posts.7z

My job is to read this file, convert to csv file and do some analyze at hive or sql.

I got following error. I also increased Xms to 4gb.

Thanks for help

[manodwhb]

@not specified not specified​ , Have you able to read 80 GB file? If You are using Talend Big data enterprise edition then you can try to use BigData Spark job to process this file run on EMR.

Thanks,

Manohar