Data Synchronization - Real time data replication

[nestoru]

Hello community,
Before we jump into considering other tools I want to know if anybody has implemented realtime data replication with Talend. From the only hit of my search ( http://www.talend.com/solutions-data-integration/data-synchronization.php ) I just get a link to contact Talend which of course means this is not publicly available knowledge but instead a product or something similar you will need to pay for.
I am interested in genuine open source solution for this before I decide to evaluate vendors. Talend looks like a robust open source project that we are already using so it makes sense to use it for data replication if possible. If there are any tutorials, white papers, user or developer documentation in the subject I would appreciate a link. I will be more than happy to write a tutorial to give back to the community on this important subject.
Just in case you are wondering what data synchronization or replication means or what I need it for: We have a SQL Server database from which some tables must be replicated in our MySQL database. The replication needs to be with low latency meaning that when a record is inserted in SQL Server the MySQL database should see it ASAP.
Thanks for reading and hopefully for responding with useful information.
Best regards,
-Nestor

[Anonymous]

Hi Nestor,
You're right. Currently only our subscription editions offer dedicated components for data synchronisation and replication. However, you could also have some workaround to use in the open source edition.
For example:
Have a tInfiniteLoop that keeps executing the job. The first component would be a tSQLServerInput with a query that gets data inserted in the last second (considering you have a timestamp in your table of course), then you do the necessary transformation and put that into a tMySqlOutput.
So it would look like that:
tInfiniteLoop --Iterate-->tMSSQLInput ---> ...Transformations... ---> tMySQLOutput
And of course you could define the time frame between each verification, and put that into a context variable for example!

[nestoru]

Hi vgalopin,
Very useful information indeed. In our case the source data comes from a proprietary third party vendor. Their tables have no timestamp columns (I know, very bad decision) so bottom line we will need to change their tables to meke this job work. Definitely something we should take into consideration when evaluating the options.
Thanks!
-Nestor

[Anonymous]

Nestor,
Also, if you're really interested into the data synchronization, I'm sure you can contact our representatives and ask for a free demo, we have some brains up there that might have other solutions for this.
For the demo request you can follow that link : Request a demo
And in the What is your primary interest? section, you can select Data Synchronization.
Hope that will help you understand the options you can!