topic Re: handling of schema dynamically in Talend Studio

handling of schema dynamically

Anonymous — Sat, 16 Nov 2024 08:36:12 GMT

hello all..

i need to convert xml file to json and insert that into maprdb. How can I handle schema dynamically in that.

Suppose my XML has 10 fields and most of the time 3 ,4 field contains null values so in that case i just want to store rest fields having values and i don't want to store all 10 fields.But in some time all the fields have values and there is need to store all the fields.

So to avoid wastage of space i just want to save the fields having some value other then null.Can in do this in talend?

Re: handling of schema dynamically

Jesperrekuh — Mon, 05 Mar 2018 18:14:56 GMT

There's a component to convert from XML to JSON

https://exchange.talend.com/#marketplaceproductoverview:marketplace=marketplace%252F1&p=marketplace%252F1%252Fproducts%252F1579&pi=marketplace%252F1%252Fproducts%252F1579%252Fitems%252F2724

Sidenote, basics Document type which you easily can convert to json i assumen...

Good Luck

Re: handling of schema dynamically

Anonymous — Mon, 12 Mar 2018 11:47:19 GMT

hello..

I am able to change xml to json that is not the problem for me.

I want to handle schema dynamically. Like if 4 columns have value that 4 columns should be stored in maprdb and if 7 columns have values than 7 columns should be stored.

Re: handling of schema dynamically

Anonymous — Mon, 12 Mar 2018 19:33:54 GMT

@shalla - not entirely sure on your use case. But I can think of an approach: If your input would have been a delimited , the solution would hav ebeen lil different For XML ------ Option 1 pick up the maximum possibility hierarchial xml schema file and use as input. tXMLInput (xpath is just "/" -> tXMLMap -> Map all fields to right -> use tJavarow like to filter out or write conditions -> flatten out the file -> arrange back to JSON. Options 2 I have never tried data type as Dynamic with XML type , give it a try. For delimited dynamic data type schema works perfectly fine. only available in enterprise not TOS.

Re: handling of schema dynamically

Anonymous — Thu, 15 Mar 2018 02:55:18 GMT

@snayak thanku for your response . I will try try that.I am using enterprise.

My use case is dynamically handle the schema in terms of number of columns.Some time xml file has all 30 fields and some time 30-N .