Validate data and export errror

Anonymous — Fri, 11 Aug 2017 11:43:17 GMT

Hi everyone,

I have a data row with thounsand columns, I 'm checking if each column have right data by tSchemaComplianceCheck (check length and data type).

Now I want to export if any column have error data. Some informations i want to export are:
+ value of key column

+ the name of error column

+ the error data

+ the error message, if a column have more than one error(invalid length and datatype), the error messages are sepatated with comma.

Each error column is exported to one row.

Can you give me some solution ?

Thank all.

Re: Validate data and export errror

Anonymous — Fri, 11 Aug 2017 13:02:17 GMT

hey,

what is the source you are getting the data from? DB , csv etc

Anonymous — Sat, 12 Aug 2017 03:08:12 GMT

I'm getting data from DB Redshift and export error to CSV file