Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to Validate source data before loading into Target data?

Hi Experts,
How to perform validation checks for source data like excel file before loading correct data into Target like SQL SERVER 2008 database.
With Regards,
Viswanath.
Labels (2)
24 Replies
Anonymous
Not applicable
Author

Hi,
I am getting the following error while deploying to MDM server from studio. Please help me in resolving this issue. I have uploaded the FastInfoset.Jar file into lib/java folder but still getting same error
java.lang.NoClassDefFoundError: org/jvnet/fastinfoset/FastInfosetSource
Anonymous
Not applicable
Author

@praveens_p
please, open your own post.
regards
laurent
Anonymous
Not applicable
Author

@svisu87
have a look at tSchemaComplianceCheck for schema validation control :
https://help.talend.com/search/all?query=tSchemaComplianceCheck&content-lang=en
for some more data quality use Talend DQ tools.
regards
laurent
Anonymous
Not applicable
Author

Hi experts,
Thank you for your reply.
In my Scenario, I need to validate excel file in Source i.e. file contains 36 columns if file have more or less than 36, then data should not load into target table.
To perform this exercise, what should we do?
With Regards,
Viswanath.
Anonymous
Not applicable
Author

Hi,
From your description, have you checked the component TalendHelpCenter:tFileProperties
Best regards
Sabrina
Anonymous
Not applicable
Author

is it possible to use tschemacompliancecheck against hive table?
Anonymous
Not applicable
Author

Hi dooncomputer,
What's your job requirement? Could you please give us more information about your requirement? Actually, there is no limitation about the input sources.
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi xdshi,
My scenario given below:
1. data verification between source and target databases
2. Informix is my source, oracle is my target.
3. Data is migrated from informix to oracle.
4. I need to validate the data between these database tables.
5. Send the unmatched rows to excel file
6. How do I do using talend? Need help on this.
Anonymous
Not applicable
Author

Hi  smathan,
If we understand your requirement very well, you want to capture the changed data and only load these changed data into excel? If so, with talend open studio product,  you need to compare tables to achieve your goal.
The work flow should be: Target DB-->tMap(make inner join on your input and set the "Catch lookup inner join reject" as true)-->outputexcel
                                     Source DB-->
The output will be the changed data.
Let us know if it works.
Best regards
Sabrina