Qlik Community

Qlik Sense Data Connectivity

Discussion board where members can learn more about Qlik Sense Data Connectivity.

DavidŠtorek
Contributor III

REST connection to specific JSON structure (Open TSDB)

Hello comunity,

I need to connect to Open TSDB (special timeseries database working with Hadoop - OpenTSDB - A Distributed, Scalable Monitoring System) using its api (HTTP API — OpenTSDB 2.3 documentation). Unfortunately i get JSON response in folowing format:

[{"metric":"volt_l3","tags":{"device":"dev4tech2_sm5"},"aggregateTags":[],"dps":{"1501452319":230.60000610351562,"1501452349":230.6999969482422,"1501452379":230.6999969482422,"1501452409":230.6999969482422,...,"1501492010":227.10000610351562}}]

and it is interpreted by Qlik Sense as :

..."dps":{"1501452319":230.60000610351562,...

..."table name”:{„field name“ : value,

but it should be something like:

..."table name”:{"field named Time value" : metric value,...

So if I connect data I get a thousands of fields with one value. Output is like this:

LIB CONNECT TO 'test';

RestConnectorMasterTable:

SQL SELECT

    "__KEY_root",

    (SELECT

        "1501192815",

        ...(thousands of other fields)...

        "1501245766",

        "__FK_dps"

    FROM "dps" FK "__FK_dps")

FROM JSON (wrap on) "root" PK "__KEY_root";

The main issue is that there are new records in database (time and some value) ~every 10 seconds and with this output I am not able to load them withouth complete changing of load script. Do you have any sugestions how to handle this? How to force Qlik to read data in a required way?

Thank you in advance.


I am using Qlik Sense June 2017 and its REST connector

1 Solution

Accepted Solutions
DavidŠtorek
Contributor III

Re: REST connection to specific JSON structure (Open TSDB)

Hi,

in meantime i found kind of work around. Just add to url address to the end ...&arrays=true.

The result will be that you get output formated as array of arrays ant than it is a little bit better for data load.

Documented on JSON Serializer — OpenTSDB 2.3 documentation

7 Replies
gladi-cz
Contributor

Re: REST connection to specific JSON structure (Open TSDB)

I have same issue. Could mto‌‌‌ help us?

Thanks,

Petr

Employee
Employee

Re: REST connection to specific JSON structure (Open TSDB)

Hi Guys - thanks for the notification - I have added daz‌ on this thread - he may be able to provide some more insight.

Regards,
Mike Tarallo
Qlik
gladi-cz
Contributor

Re: REST connection to specific JSON structure (Open TSDB)

Hi mto‌ & daz‌,

Do you have any ideas?

Thanks for replay,

Petr

Employee
Employee

Re: REST connection to specific JSON structure (Open TSDB)

Hey Petr - let me directly follow up with him.

Regards,
Mike Tarallo
Qlik
teamxanalytics
New Contributor II

Re: REST connection to specific JSON structure (Open TSDB)

Did you guys ever solve this problem? I'm running into the same thing.

DavidŠtorek
Contributor III

Re: REST connection to specific JSON structure (Open TSDB)

Hi,

in meantime i found kind of work around. Just add to url address to the end ...&arrays=true.

The result will be that you get output formated as array of arrays ant than it is a little bit better for data load.

Documented on JSON Serializer — OpenTSDB 2.3 documentation

teamxanalytics
New Contributor II

Re: REST connection to specific JSON structure (Open TSDB)

Ended up using this too! Thanks for the tip.

Community Browser