topic Re: Basic SCD syntax error in Talend Studio

Basic SCD syntax error

Anonymous — Sat, 16 Nov 2024 03:06:20 GMT

Hello. I am new to Talend and learning.

I am trying to do a tDBSCD component on basic customer information. I am reading from SQL server and populating back into SQL server. When I run the job I get the following error: " Incorrect syntax near 'WHERE' " , repeated a number of times.

I included a screenshot below of the SCD setup.

Any help in discovering the cause of this error is appreciated.

Thank you.

Re: Basic SCD syntax error

nivedhitha — Tue, 03 Mar 2020 21:32:34 GMT

@kwahl, Is it the tDBInput or the scd component that is giving the error?

Can you provide screenshots(the configuration section) of both the component?

Re: Basic SCD syntax error

Anonymous — Tue, 03 Mar 2020 22:27:50 GMT

tDBSCD is the component with the error

Screenshot 2020-03-03 at 15.27.05.png
Screenshot 2020-03-03 at 15.26.51.png

Re: Basic SCD syntax error

nivedhitha — Wed, 04 Mar 2020 21:52:14 GMT

@kwahl , Can you also ensure the below columns (start and end) actually exist in your target table(the scd-2 table)?

Re: Basic SCD syntax error

Anonymous — Wed, 04 Mar 2020 21:56:10 GMT

screenshot below of table from ssms

[image: Screenshot 2020-03-04 at 14.53.34.png]

Re: Basic SCD syntax error

Anonymous — Wed, 04 Mar 2020 21:57:35 GMT

oops, can't insert photo from email.

Re: Basic SCD syntax error

manodwhb — Thu, 05 Mar 2020 03:52:25 GMT

@kwahl , can you share the configuration of tDBSCD component?

Re: Basic SCD syntax error

Anonymous — Thu, 05 Mar 2020 14:57:15 GMT

Re: Basic SCD syntax error

nivedhitha — Thu, 05 Mar 2020 15:11:35 GMT

@kwahl ,

The issue is there are no source keys mentioned. There has to be a key field on which a lookup will be made to see if any of the dimensions have changed.

Looking at your table I'm guessing customerid might be your key

Re: Basic SCD syntax error

Anonymous — Thu, 05 Mar 2020 15:14:10 GMT

is a 'source key' synonymous with 'surrogate key'?

Re: Basic SCD syntax error

nivedhitha — Thu, 05 Mar 2020 15:18:54 GMT

No. the surrogate key is just a column with sequential numbers in your case. source key is the is the column with which you identify which row you are referring to. It is based on that key, say the customerid you decide if any of the dimensions like name or status or class has changed. For every change you will see a new record inserted with the existing record expired

Re: Basic SCD syntax error

Anonymous — Thu, 05 Mar 2020 15:26:10 GMT

OH! i see what you mean. it works now! thank you!