Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
varadharaj
Contributor II
Contributor II

Lookup functionality in HDFS target

I have 2 tables

Table A

ID Name Dept Id

1 ABC 10

Table B

Dept Id Dept Name

10           IT

So i need to add the column dept name in Table A as

ID, NAME,DEPT ID,DEPT NAME

Please suggest any possible ways to do it .

using compose version -->V6.5.0.179 with spark project (HDFS)

 

 

Labels (1)
2 Solutions

Accepted Solutions
Madhavi_Konda
Support
Support

Hi Varadhraj,

On your metadata screen for table A, add the column dept_name as new attribute and choose the datatype and click validate.
On data storage tasks, please double click on a mapping. You will see lookup icon on dept_name column.
Please open and then enter condition like ${Lookup.dept_id}=${Landing.dept_id} and result column as
${Lookup.dept_name} and click ok. Validate the changes. Drop and recreate the necessary tables if necessary.


Please raise a support case if it is not clear. We can walk through the steps.

Thanks,

Madhavi

View solution in original post

2 Replies
Madhavi_Konda
Support
Support

Hi Varadhraj,

On your metadata screen for table A, add the column dept_name as new attribute and choose the datatype and click validate.
On data storage tasks, please double click on a mapping. You will see lookup icon on dept_name column.
Please open and then enter condition like ${Lookup.dept_id}=${Landing.dept_id} and result column as
${Lookup.dept_name} and click ok. Validate the changes. Drop and recreate the necessary tables if necessary.


Please raise a support case if it is not clear. We can walk through the steps.

Thanks,

Madhavi