Unable to profile and sample data from a csv file that has json data as one of the column

Anonymous — Sat, 16 Nov 2024 02:06:52 GMT

When trying to harvest metadata in Talend data catalog from the below sample file, unable to profile or sample data due to multiple delimiters in the file. Tried providing characters condition in Miscellaneous. But not sure where it is going wrong. What should be done to resolve this?

id,type,json-block
AAB2C45,ADD TYPE,"{
""Id"": ""2284"",
""hashedId"": ""jhvsbirfheszknek547368kjgbvskjdg"",
""market"": ""IN"",
""language"": ""en"",
""profile"": {
""base"": {
""user"": ""abc@gmail.com"",
""fn"": ""ab"",
""ln"": ""bc"",
""address"": [
{
""Type"": ""home"",
""details"": [
{
""address"": ""en-IN"",
""addressLineDetails"": {
""country"": ""IN"",
""zipCode"": ""43205""
}
}
]
}
]
}
}
}"

Re: Unable to profile and sample data from a csv file that has json data as one of the column

vapukov — Thu, 25 Jun 2020 04:48:22 GMT

Hi,

not sure how it with Data Catalog, but for Studio you need to use "\"" for both escape char and escape text in CSV options, then it will be displayed correctly

topic Re: Unable to profile and sample data from a csv file that has json data as one of the column in Talend Data Catalog

Unable to profile and sample data from a csv file that has json data as one of the column

Re: Unable to profile and sample data from a csv file that has json data as one of the column