I am using Talend Open studio. My requirement is to merge data from staging (MariaDb database) table to production (MariaDb database) table. Tables schemas match on both staging and production database. I want to have a generic job which will accept table name as input and do the merge for that so it needs to read schema dynamically.
Please suggest if this is possible in Talend Open studio. I read that there is tSetDynamicSchema component in enterprise edition but is there anything alternative in open studio?
There are no straight forward methods for Open Studio version. One of my colleague @groupproductmanagement has created a Dynamic ingestion job to target Oracle database. If you make changes to the existing flow (like files with your source DB and MariaDB instead of Oracle as target, it may work.
I have not personally tried it. But technically its possible provided you are giving correct metadata information and internal tables. Please note that throughput might be slightly less if you are planning to use this process for very large tables. The reason is that its generating individual insert records and its not doing bulk load.
But within the limitation of Open source version, this should be still helpful for your use case.
Warm Regards, Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved
I believe you will have to switch to Enterprise version of Talend for this use case.
Warm Regards, Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved
