topic Re: Reading .gz without uncompressing it in Talend Studio

Reading .gz without uncompressing it

Anonymous — Mon, 25 Mar 2019 11:13:46 GMT

Hi All,

I need to read txt.gz file and but I dont want to extract it because I need only first row (header) and count of lines in the file.

Any help will be appreciated.

vapukov — Mon, 25 Mar 2019 12:16:40 GMT

but how you are thinking to count the number of rows without unarchiving the file? even if it will be in memory, it is. still will be unarchiving

akumar2301 — Mon, 25 Mar 2019 12:20:34 GMT

if you are on Liunx machine , check if you have zgrep/gunzip command.

if yes , you could use tSystem and Zgrep/gunzip .

vapukov — Mon, 25 Mar 2019 12:25:31 GMT

@uganesh wrote:

if you are on Liunx machine , check if you have zipgrep command.

if yes , you could use tSystem and Zipgrep .

for grep (pattern search) - yes

but for row counts?

in any case -

zipgrep is a shell script and requires egrep(1) and unzip(1L) to function

it's not a "magic button" it uncompress the file and do the proper job 🙂

Anonymous — Mon, 25 Mar 2019 13:23:11 GMT

Hi Vapukov

Thanks for responding. Actually I was thinking if we have some existing component in Talend that can do the similar stuff like in Unix.

zcat file.txt.gz | wc -l

Anonymous — Mon, 25 Mar 2019 13:25:24 GMT

Thanks for responding Abhishek, but I am using Windows. Do you any window command that will do the same thing.

tamilselvan1 — Thu, 21 Oct 2021 07:34:56 GMT

any update on the question