topic Re: How to uncompress (inflate) gzip REST Api response? in Talend Studio

How to uncompress (inflate) gzip REST Api response?

Jesperrekuh — Mon, 14 May 2018 13:49:09 GMT

Would love to know how to decompress / uncompress (inflate) gzip String? Please : Without saving it as a zip file.

It's response of a rest-api call UTF-8 compressed

Would be nice if there are some functions related to string-handling: package (doc) util.java zip

cheers + thanks!

Re: How to uncompress (inflate) gzip REST Api response?

manodwhb — Wed, 16 May 2018 08:28:17 GMT

@Dijke,you can use tFileArchive and tFileUnarchive ,Folder to zip and unzip.

please find the below links

https://help.talend.com/reader/iYcvdknuprDzYycT3WRU8w/4HqSCsyne6rLWociYNchDQ

https://help.talend.com/reader/WWQ40R_iTE5~~9VkUQrjgQ/7Bj99i9HHD~wcAItQuK9Zw

Re: How to uncompress (inflate) gzip REST Api response?

Jesperrekuh — Wed, 16 May 2018 16:18:24 GMT

@manodw , sorry, but not a proper solution. very inefficient!

I get a server response (gzip) -> (allready in memory) -> disk i/o-> fileOut -> fileIn -> disk i/o -> (unzip process) -> back in memory
should be server response (gzip) -> (allready in memory) -> decrypt bytes in memory -> save to db / disk i/o OR do whatever I wanna do.

Re: How to uncompress (inflate) gzip REST Api response?

Sarye — Wed, 10 Oct 2018 13:44:40 GMT

Hi everyone,

I'm facing exactly the same issue as @Dijke:

- I perform an API call through tRESTClient.
- The server's response has the header: content-encoding: [gzip]
-- So It's gzip compressed. The API documentation formally stipulate that clients has to activate gzip handling, because the response is always gziped.
- But tRESTClient's output schema has default values and the gzip content is cast as a string in the default field "string" . As a result, I can not read the response. Here the tLogRow Output :

Does anyone has found a solution ? Thanks.

Re: How to uncompress (inflate) gzip REST Api response?

Sarye — Sun, 27 Jan 2019 16:04:45 GMT

Hi, I found a solution and here it is!

I've also opened a Jira ticket to report the issue: https://jira.talendforge.org/browse/TDI-41702, fell free to vote it up.

Here is a piece of Java code that inflat a GZIPed API response. For the demo I used StackExchange API which by default GZIP its reponses.

tJava Advanced Settings

import java.util.zip.GZIPInputStream;
import java.io.InputStreamReader;
import java.io.BufferedReader;
import java.net.HttpURLConnection;
import java.net.URL;

tJava Basic Settings

// Ini API CALL
URL url = new URL("https://api.stackexchange.com/2.2/info?site=stackoverflow");
HttpURLConnection con = (HttpURLConnection) url.openConnection();
con.setRequestMethod("GET");
con.setRequestProperty("User-Agent", "Test");

// Store ResponseCode
int status = con.getResponseCode();

// Inflat gzip stream (the API response content is gziped)
GZIPInputStream gzis = new GZIPInputStream(con.getInputStream());
InputStreamReader reader = new InputStreamReader(gzis);
BufferedReader in = new BufferedReader(reader);

// Send the output to next component, line by line
String readed;
while ((readed = in.readLine()) != null) {
//   System.out.println(readed);
	row2.content = readed;
}

Re: How to uncompress (inflate) gzip REST Api response?

rgagnon — Fri, 08 Mar 2019 18:47:33 GMT

In Talend 7.1.1, the tESBConsumer component supports GZIP encoding.

Re: How to uncompress (inflate) gzip REST Api response?

RGriveau — Tue, 06 Sep 2022 10:57:48 GMT

How do you do a REST call with a tESBConsumer?