Read Dynamic JSON schema files and load into DB Table

[madhukolli2003]

Hi ,

We are receiving below kind of json data and we need to load into DB table.

Key values are different for each array and job needs to create a column for each Key.

I am familiar to create dynamic schema using flat file, do we have any option to implement same for JSON files. 

{
"newsletter_mask": [
{
"mask_intraday": "f",
"mask_dig|hr": "f",
"mask_insurance_mask": "f",
"mask_new_retirement": "f",
"mask_daily": "f",
"mask_wellness": "f",
"mask_voluntary_final": "f",
"mask_new_health_care": "f",
"mask_best_of_the_week": "f"
}
]
}

{
"newsletter_mask": [
{
"mask_daily": "t",
"mask_voluntary_final": "f",
"mask_insurance_mask": "f",
"mask_dig|hr": "f",
"mask_intraday": "f",
"mask_best_of_the_week": "t",
"mask_new_health_care": "f",
"mask_wellness": "f",
"mask_new_retirement": "f"
}
]
}

Thanks in Advance !

[Anonymous]

Hello,

The tFileInputJSON component does have a bit of a learning curve, but is both powerful and flexible, and you'll almost certainly want to set up each different JSON file format as metadata, in order to use the wizard, rather than configuring the components manually.

Does this have a fixed schema to which the JSON data needs to be mapped? If your target database has a fixed schema, then you'll definitely need to know the JSON schema for your files.

Perhaps you could convert the JSON file to a flat file, e.g., http://www.convertcsv.com/json-to-csv.htm, and access the flat file with a schema defined with a single dynamic column.

In addition to that, Talend Data Mapper (TDM) can convert the JSON to a flat file.

Best regards

Sabrina