topic Re: merging data without key/join in Talend Studio

merging data without key/join

Anonymous — Sat, 16 Nov 2024 13:48:54 GMT

Hi,
I would like to merge some data in TOS - Im pretty new to TOS so maybe it is easy and I just do not know how to do it.
In the job I get data from an xml-file, two fields 'name' and 'position'
In a ms-sql-table I update a pid (..set pid = pid + 10 where..) for any new entry (no, autoincrement is not a option, two different tables...otherwise that would be easy), select that pid from the transaction and than commit it, so I can be sure I got the pid I just updated (multiuser-system)
Now I would like to write in a different table this three values: name, position and the pid I set in the update.
I set up the job with xml-job, main-output in a tMap and an iterate-link to the mssql-row.
The mssql-row links with onComponentOk to the mssql-input (the select).
If I try to link the main-row from this mssql-input to the tMap, I got a locked-sign.
Probably it is a sync issue but how can I manage it?
Best regards,
Harald

Re: merging data without key/join

Anonymous — Wed, 19 Aug 2009 03:46:30 GMT

Hello Harald
I think you are going to create a cycle flow in a job. It is forbidden. For solution, see 1468.
If you still have any trouble, please upload some screenshots of your job.
Best regards

shong

Re: merging data without key/join

Anonymous — Wed, 19 Aug 2009 08:04:29 GMT

Hi,
I fear you are right, that this might be a cycle-job :-|
I uploaded two screens showing the idea of the job I would like to setup.
The MSSQl_Row does the update, the Input gets the new pid (serval) from the table

Re: merging data without key/join

Anonymous — Wed, 19 Aug 2009 08:18:32 GMT

Hello
Yes, there is a cycle flow in your job. see screenshot1
You need redesign the job as screenshot2 shows.
Best regards

shong

Re: merging data without key/join

Anonymous — Wed, 19 Aug 2009 10:51:12 GMT

Thank you very much for helping me.
I had that idea some days ago but I get a "Iterate kann not be resolved" if I start this job (of course caused by the xml-Output iterating the mssql_row).
In my first job (as shown in screenshots) the iteration works fine with the very same xml-output (as long as I do not merge the data in that tMap...)
OK, that is fixed, the xml_output which iterates the mssql_row need a main-output to e.g. tLogRow, than it works.

But the output of that tMap is wrong now....
The xml-file has 7 valid entries for example.
Now I get 7 rows with the first pid and this 7 xml-entries, then 7 rows with the second pid and this 7 xml-entries, then 7 rows with the third and so on....

Best regards,
Harald

Re: merging data without key/join

Anonymous — Sat, 22 Aug 2009 14:36:25 GMT

Anyone an idea how I can resolve this problem?
I thought about a temp-file, counting the rows and tAggregateRow but that is not really elegant and I had no opportunity to design this idea now.
So I do not know if it will solve that issue at all.
Kind regards,
Harald

Re: merging data without key/join

Anonymous — Mon, 24 Aug 2009 07:17:14 GMT

Hello Harald
Please upload the current job...and what are your expected result?
Best regards

shong

Re: merging data without key/join

Anonymous — Thu, 05 Nov 2009 22:10:13 GMT

Hello!
Is it possible to read from a msword .doc file ?