Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi Shong,
I have a situation,
i am having source table which contains lots of special characters in multiple columns.
i handled for single column using tReplace component but its very lengthy to take every column in tReplace which contains Special characters.
Is there any other way to handle multiple columns at a time for special characters.
This is the list of Special Characters that i have in my data and Replace_By value for every special characters
Waiting for positive reply.
Thanks,
Shri_Kul1
Talend User
I have a situation,
i am having source table which contains lots of special characters in multiple columns.
i handled for single column using tReplace component but its very lengthy to take every column in tReplace which contains Special characters.
Is there any other way to handle multiple columns at a time for special characters.
This is the list of Special Characters that i have in my data and Replace_By value for every special characters
Waiting for positive reply.
Thanks,
Shri_Kul1
Talend User
Hi Amol,
No, Metadata1 doesn't contain any null values. Null values are in metadata file which is lookup value and contains replace by column which contains null values.
My original job is like this.
No, Metadata1 doesn't contain any null values. Null values are in metadata file which is lookup value and contains replace by column which contains null values.
My original job is like this.
Hi All,
I have done it after all, Please see image attached here and solution for it as follows-
1)Sort out data on the basis of EXPECTED & REJECTED records through your business rule like NAME should not be null if it is null then it should go under ERROR table. After that take 1 variable and put this logic - Source.triNameTX==null?"(triNameTX Should not be Null)":"" and use this variable in REMARK column of ERROR table.
2)START date should less that END date - Var2- (Source.triSTARTDA != null && (Source.triSTARTDA.before(Source.triENDDA))) ||
Source.triSTARTDA == null (Boolean Type)
Var3 -(Source.triSTARTDA!= null && (Source.triSTARTDA.after(Source.triENDDA)))||Source.triSTARTDA == null?"(triSTARTDA Should'nt be NUll or Less than triENDDA)":""
3) Now, Concatenate Var.var1+Var.var2 and run your job & after completion of your job take look into REMARK column , you will see -(triNameTX Should not be Null)(triSTARTDA Should'nt be NUll or Less than triENDDA).
so like wise you can do it for many columns as per your Business Rule.
Rejected Output File..
I have done it after all, Please see image attached here and solution for it as follows-
1)Sort out data on the basis of EXPECTED & REJECTED records through your business rule like NAME should not be null if it is null then it should go under ERROR table. After that take 1 variable and put this logic - Source.triNameTX==null?"(triNameTX Should not be Null)":"" and use this variable in REMARK column of ERROR table.
2)START date should less that END date - Var2- (Source.triSTARTDA != null && (Source.triSTARTDA.before(Source.triENDDA))) ||
Source.triSTARTDA == null (Boolean Type)
Var3 -(Source.triSTARTDA!= null && (Source.triSTARTDA.after(Source.triENDDA)))||Source.triSTARTDA == null?"(triSTARTDA Should'nt be NUll or Less than triENDDA)":""
3) Now, Concatenate Var.var1+Var.var2 and run your job & after completion of your job take look into REMARK column , you will see -(triNameTX Should not be Null)(triSTARTDA Should'nt be NUll or Less than triENDDA).
so like wise you can do it for many columns as per your Business Rule.
Rejected Output File..
tGroovyRow allows you to do row-based processing in the Groovy language (essentially a superset of Java). Since the tGroovyRow component gets its input as a HashMap named input_row, you can process each field of each row as a closure. That makes it very efficient to apply the same search/replace or other transformations to multiple fields on the same row.
See below for how I use this technique to remove all carriage returns and newlines from each field of type String. I'm also doing a null check and transforming that into an empty String before doing the replace operations.
FYI, to use this, you'll need " tGroovyRow (updated)" (available at this link). It should be available in Talend Exchange soon once approved. I've tested it in TOS 6.1.1, Groovy 2.4.5 (bundled in my updated version), and Java 1.8.
The original " tGroovyRow" is available in Talend Exchange, but I needed to tweak it before it would run in TOS 5.6.x and it uses the default version of Groovy (1.0) bundled with TOS.
See below for how I use this technique to remove all carriage returns and newlines from each field of type String. I'm also doing a null check and transforming that into an empty String before doing the replace operations.
FYI, to use this, you'll need " tGroovyRow (updated)" (available at this link). It should be available in Talend Exchange soon once approved. I've tested it in TOS 6.1.1, Groovy 2.4.5 (bundled in my updated version), and Java 1.8.
The original " tGroovyRow" is available in Talend Exchange, but I needed to tweak it before it would run in TOS 5.6.x and it uses the default version of Groovy (1.0) bundled with TOS.
input_row.each { key, value ->
if (value.getClass() == String)
value = value?.replace("\r","").replace("\n","")
output_row = value
}