topic Re: [resolved] tJavaFlex output issue in Talend Studio

[resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 09:06:31 GMT

Hi Everyone,

I'm having problem with the component tJavaFlex. I'm using it to create a row for each day between two date as you can see in the printscreen bellow.

It's working well, except when I want to insert the result in my DB, because I want to drop and create the table before the new insert. I did put this Action on table parameter, on my tMSSqlOutput, but because of the tJavaFlex loop, it drop and create a table each time a new loop is finish, ans I only get the last result in my DB.

Does anyone know how change the output flow of tJKavaFlex in only one flow ?

Do not hesitate to tell me if my explanation isn't clear enough,

Thank's in advance,

Julien

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 09:18:15 GMT

Can you show us your job structure please? My immediate thought is that if you are connecting using a flow, this shouldn't happen. If you show us your job structure, it will be easier to see what might be happening.

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 09:23:20 GMT

Hi Rhall,

Here is my job structrure,

Thank's for your help,

Julien

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 09:39:45 GMT

OK. It is the tFlowToIterate that is causing the issue.

For every row in the flow that hits the tFlowToIterate, it iterates the rest of the subjob per row. For every iteration, the tMSSqlOutput is restarted which is causing your issue. This is actually quite useful functionality in some situations, but not in this one. What you can do to get round this is to output your data from the tJavaFlex to a tHashOutput and use a tHashInput in a new subjob to read the data in and pass it to the DB.

An example of how to do this is here: https://help.talend.com/pages/viewpage.action?pageId=8123271#technical-thashinput-scenario_speed

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 10:37:18 GMT

Thank's a lot Rhall, this solution is great !!

Could you please explain me, for my general knowledge, why it's so faster than updating the table each time a loop is finish ?
Update takes more than 300s and tHash solution takes less than 15s.

Julien

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 10:43:02 GMT

I suspect you are seeing a difference in performance because previously you were dropping and creating a table for every row from your D_SEJOUR_MVT query. Now you are creating your dataset and inserting it after dropping and creating your table once.

Re: [resolved] tJavaFlex output issue

Anonymous — Fri, 26 Aug 2016 10:53:05 GMT

That makes sense.

Thank's again for your help !!

Have a good day,

Julien