topic Re: tFileUnarchive - How to know if the zip is invalid or has no entries? in Talend Studio

tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Thu, 11 Aug 2016 14:36:11 GMT

Hello,
I have a question concerning the tFileUnarchiveComponent. I'm using it on some zip files, some of which may be invalid and some of which may have no entries. I would like to link to a component when an invalid zip file is encountered and I'd like to know if there are no rows (ie. no files) from a particular zip.
(Surprisingly, the onComponentError flow is not activated when there is an invalid zip.)
I'd be very grateful for any links to solutions or ideas for alternatives...
Thanks!

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Fri, 12 Aug 2016 04:59:59 GMT

Hi,
Could you please take a look at component TalendHelpCenter:tFileProperties which obtains information about the main properties of a defined file.
There is a "size" schema (the file size in bytes). You can use it to check your invalid file with no entry(the file size should be 0).
Best regards
Sabrina

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Fri, 12 Aug 2016 07:49:58 GMT

Hi Sabrina,
Thanks for the reply. So I can use this component to determine if a zip file is empty. But what if a zip file is corrupt and can't be opened by the tFileUnarchive component? Is there any way of knowing this? The component logs an error but the onComponentError does not seem to be called when the archive is invalid...
François

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Fri, 12 Aug 2016 10:14:42 GMT

Hi,
What's kind of component error message you are getting?
OnComponentError will trigger the sub-job or component as soon as an error is encountered in the primary Job
Best regards
Sabrina

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Fri, 12 Aug 2016 11:40:50 GMT

When using a corrupt zip, the tFileUnarchive component writes "archive is not a ZIP archive" in the log. If "Check the integrity before unzip" is checked then it writes "The file <xxx> is corrupted, process terminated..." to the log.
But in neither case is the onComponentError triggered. I was expecting to be able to use that trigger to determine that an archive is invalid...
Thanks,
François

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

cterenzi — Fri, 12 Aug 2016 15:59:25 GMT

I was able to trigger onComponentError execution by checking "Die on Error" in tFileUnarchive's settings. Will that help you?

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Fri, 12 Aug 2016 16:25:26 GMT

Thanks. That would be logical. I tried that but am still just getting an error in the log and the onComponentError does not get triggered. Maybe I'm missing some global configuration - will look into that possibility...
Thanks again.

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Mon, 15 Aug 2016 08:20:57 GMT

Hi François.
Is there any update for your issue?
Best regards
Sabrina

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Thu, 18 Aug 2016 10:07:55 GMT

Hi Sabrina,
I tried cterenzi's solution but if I check "Die on error" the onComponentError still does not get triggered. Is this behavior that can be configured?
Regards,
François

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Thu, 18 Aug 2016 10:15:27 GMT

Hi,
Would you mind sending an invalid zip file(corrupt, can not open by tFileUnarchive component)to us? In this way, we can make a simple testing for your use case.
Is your job design:tFileUnarchive-->oncomponenterror-->tfileinputproperties?
Best regards
Sabrina

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Mon, 22 Aug 2016 12:41:09 GMT

I use any file that is not a zip file (e.g. the one attached). The tFileUnarchive component logs "archive is not a ZIP archive" when "Check the integrity before unzip" is unchecked. When that option is checked then I get "The file C:/tools/talend_workspace/archive.zip is corrupted, process terminated...".
In neither case does the OnComponentError get triggered.
archive.zip_20160822-0440.zip

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Wed, 24 Aug 2016 09:50:26 GMT

Hi,
The attachment you provided is not avaliable on talend forum. Could you please take a look at it?
Best regards
Sabrina

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Tue, 30 Aug 2016 10:05:17 GMT

Hi,
The zip may have been blocked by my firewall. It doesn't matter, you can use any file that is not a zip file e.g. Take a jpg and rename it .zip to obtain an invalid zip file. When you try to unzip it with the tFileUnarchive component you will get the behavior described in my previous post i.e. OnComponentError does not get triggered.
Best,
François

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

David_Beaty — Mon, 21 May 2018 15:06:55 GMT

Hi Francois,

I don't think the tFileUnarchive component, as standard, will allow you to do what you want. The only semi-sensible solution I could come up with, was to enable the "Use archive file name as root directory" option, then once the component has unzipped the archive, successfully or not, is to then check the number of files in the resulting sub-directory. If this is 0, then the archive was corrupt/unzippable.

Thanks

David

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Tue, 02 Jul 2019 19:46:14 GMT

Old thread, but I had a similar issue. Solved it by using an iterate. Since tFileUnarchive will only iterate if it unzips something, you can hang a tJava off of it, and set some variable like "GoodZip" which then only gets set if it found unzipped at least one file.

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

offcourse2 — Tue, 29 Oct 2019 09:47:33 GMT

Hi all

I still have the same issue, and can't find my way around it. Althouth the iterate solution seems to work, it has two problems:

It will run whatever comes next as many times as the number of files you have found inside the zip file. Eg. If next step is to create a file and send an email, it will do it 200 times if the zip file has 200 files inside
It doesn't allow me to be warned if the zip file is corrupt, so I can go and solve whatever is wrong.

In my case, I am downloading a zip file from and FTP server, extracting the content, processing a json file which is inside and then creating and emailing an excel file. Now, if the zip file is corrupted, I have no view of that, which is what I am after.

Any new ideas?

Thanks

Re: tFileUnarchive - How to know if the zip is invalid or has no entries?

Anonymous — Tue, 29 Oct 2019 13:30:38 GMT

@offcourse2 -- you're correct.

For #1, I solved this by hanging a tJava off of the iterate that sets a "GoodZip" global variable to true. It doesn't matter whether that sets it to true 200 times. You can then hang your real logic off of a RunIf that checks for the GoodZip variable, and it will only run once.

For #2, maybe you create another RunIf where if the zip file exists, but "GoodZip" is false (i.e. it never iterated), than the file must be corrupt. Just a thought.