Salesforce --> data warehouse sync job;help following tutorial example
I'm trying to build a sync job that watches for changes in a Salesforce table using the tSalesforceGetUpdated component. I'm trying to follow the example at the very end of this tutorial
http://www.youtube.com/watch?v=sx04uHFRjdE&hd=1&autoplay=1&buffer=10&autostart=true&fullscreen=true&..., however, not much time is given to the construction of this sample. I have a couple challenges:
What are the components used to store the server timestamp? In the video, they're called "Initial Server Time" and "Save current Server Time". given that the "Start Date" of the tSalesforceGetUpdated component is spec'd as:
TalendDate.formatDate("yyyy-MM-dd HH:mm:ss",context.LAST_UPDATE)
...it looks like the output of the tSalesforceGetServerTimeStamp is pushed into a context variable. I can't even find the components in the default component list, and haven't been able to work out how you write to a context variable from a component.
Also, there's a "loop" component between the tInfiniteLoop and the tSalesforceGetUpdated components, but the icon is completely different from the one in my component list.
Big picture, the goal is:
* Run an infinite loop
* At each interval, poll Salesforce for all records changed since the last iteration
* Test retrieved records against existing records in the warehouse DB
* Write changed records as updates; new recrds as inserts.
* Repeat
Any help working this out would be greatly appreciated! Thanks in advance. -Ben
EDIT: based on this
http://talendtutorials.wordpress.com/2012/01/13/storing-temporary-values/ it looks like two of the components - the ones receiving the timestamp - are "tJavaRow" components. Still at a loss for the last one, identified as "loop" (since the icon is different from that in my v5.3 TOS). -Ben
EDIT: and yet, I don't seem to have a tJavaRow component in my TOS <sigh>. Struggling onwards... -Ben
EDIT: ok, hopefully final edit for the day: I found out what the last component is: it's a "tJava" component. And, since there's zero information on the configuration or code for this component in the example in the tutorial, that tutorial is kind of useless. And a tease. I'd really like to get this to work, so if anyone from Talend is listening, could you please provide some additional information about the "salesforce_dw_sync" job in the tutorial I cite at the top of this post? Specifically:
What is the Java code for each of the tJava and tJavaRow components?
What are the other configuration parameters for the various tSalesforce* components?
Lastly, I can't find the tJava nor tJavaRow components in my TOS-DI v5.3.1 installation. I tried with the Big Data TOS as well, which the documentation says includes these and the other components on the "Custom Code Palette". However, that palette is missing entirely my from install. I'm just missing something fundamental, methinks.
Thank you very much. -Ben
