to use tMySQLCDC component - does a CDC db need to be installed?
Hello, I am new to Talend Enterprise Data Integration. I get an error msg: "Unknown column 'TALEND_CDC_STATE' in 'where clause' " when trying to use tMySQLCDC component in a job. I do not see TALEND_CDC_STATE column anywhere in the tables that I want to capture CDC. Does a CDC database need to be installed prior to using tMySQLCDC component in jobs? If yes, please point me to documentation describing how to install the CDC database on MySQL. Is it easy to install and to configure?
Hi, umeshrakhe
I had tried to send a E-mail but it has been forbidden by organization of gmail-smtp-in.l.google.com. So would you mind providing other E-mail address or giving me a way to get rid of it?
Best regards
Sabrina
Could you please send me demo job you explained above.
Thank you.
@xdshi wrote:
Hi,
Sorry for the delay. For your confusion, i have create a demo job using mysql DB to explain how to use the CDC connenction .
Step 1: Populating a data warehouse
The following Java scenario creates a three-component Job that populates a data warehouse. A tMysqlInput component reads your test data stored in the test base. A tMap component allows you to modify this data and the modifications are transmitted to the crm table in the CRM database through a tMysqlOutput component.
Drop the following components from the Palette onto the design workspace: tMysqlInput, tMap, and tMysqlOutput.
Connect the three components using Row Main links. see pic1
In the design workspace, select tMysqlInput and click the Component tab to define its basic settings. pic2
Set Property Type to Repository and then select the connection to the test database that holds the information about your clients. The connection details will display automatically in the corresponding fields.
Note
If you have not stored the DB connection details in the Metadata entry in the Repository, select Built-in in the property type list and set the connection details manually.
Set Schema to Repository and click the three-dot button to select the schema of the test database stored in the Metadata entry.
In the Table Name field, enter the name of the table holding the information you want to modify, in this example: test
Click Guess Query to retrieve all data from your table.
Double-click the tMap component to open the Map Editor. Notice that the Input area is already filled with the metadata of the input component. pic3
drag the fields in the input zone to the fields in the test table in the output zone. For more information regarding data mapping
Click OK to validate the operation.
In the design workspace, select tMySqlOutput and click the Component tab to define its basic settings.pic4
Waiting, i will send the step 2 and step3
Best regards
Sabrina
