topic Re: Cassandra Deep Data in Talend Studio

Cassandra Deep Data

Anonymous — Thu, 19 Apr 2018 15:35:07 GMT

I need to extract deep/nested data from Cassandra. There are sets or lists of data within the 'columns'. Please see below.

housedata_column[

{

houseaddress:4242

housecolor:red

housespecs:{

type:craftsman

sqft:2000

roof:composite}

}

]

How do I extract this data into columns for each?

Re: Cassandra Deep Data

Anonymous — Fri, 20 Apr 2018 17:19:42 GMT

bump

Re: Cassandra Deep Data

Anonymous — Wed, 25 Apr 2018 16:23:02 GMT

bump

Re: Cassandra Deep Data

Anonymous — Thu, 26 Apr 2018 09:52:31 GMT

Hello,

What does your expected result look like?

Best regards

Sabrina

Re: Cassandra Deep Data

Anonymous — Thu, 26 Apr 2018 14:56:03 GMT

@xdshiwrote:

Hello,

What does your expected result look like?

Best regards

Sabrina

Data in columns, or some usable format. E.g.:

table HOUSEDATA
HOUSEADDRESS HOUSECOLOR
4242         red

table HOUSESPECS
TYPE          SQFT       ROOF
craftsman     2000       composite

Or something similar. I just need to get the actual data in some form I can use.

Any help or suggestions appreciated.

Re: Cassandra Deep Data

vboppudi — Thu, 26 Apr 2018 15:20:14 GMT

Input data same as you specified or any other format/changes?

Regards,

Re: Cassandra Deep Data

Anonymous — Thu, 26 Apr 2018 15:31:41 GMT

@vboppudiwrote:

Input data same as you specified or any other format/changes?

Regards,

I probably shouldn't have broken it in above example. Input data is in the form:

[{houseaddress:4242,housecolor:red,housespecs:{type:craftsman,sqft:2000,roof_set:{colors:{'2,4'},type:{'4'},other{'2','4'}}}}]

Nested lists of differing formats, no common and unique delimiting character. Attempted tNormalize, tExtractJsonFields, tExtractRegex, with varying degrees of success. Contacted Talend support, tier 1 unable to help, escalated to tier 2, awaiting reply. Will post solution. Unique situation moving from Cassandra to Oracle.

Re: Cassandra Deep Data

Anonymous — Tue, 10 Sep 2019 01:33:36 GMT

@TWOF Did you get any reply on this., I am also in similar situation, I want to parse a Map data type from cassandra and load into MSSQL.

Thanks in advance for help!