Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Discover how organizations are unlocking new revenue streams: Watch here
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2017-12-12 07:49 AM

Validations in Big Data Batch Job

Hi Team,

 

I have development experience with Talend standard jobs but I am new to developing Big Data Batch Jobs in Talend. I have used tschemacompliance to validate schema data types and lengths in standard jobs in Talend. I am looking for an equivalent component in Big Data Batch job. Can you please help me understand how best we can achieve data type and length validations in a batch job? Looking forward for a timely response. 

 

Thanks and Regards,

Shiv Soni

Labels (1)
Labels
153 Views
0 Likes
2 Replies
Anonymous
Not applicable
‎2017-12-12 11:04 PM
Author

Hi,

 

Can anyone help with this please?

153 Views
0 Likes
Anonymous
Not applicable
‎2017-12-13 03:39 AM
Author

Hello,

The tschemacompliance component is a DI component and will not available in bigdata spark job, so far.

Have you tried to utilize a DI Job to orchestrate your spark job by using tRunJob component?

Best regards

Sabrina

 

 

153 Views
0 Likes