topic Re: Use variables from one output in another output after replicate in Talend Studio

Use variables from one output in another output after replicate

JayQueue — Fri, 15 Nov 2024 23:37:21 GMT

Hello,

Backstory: I'm coming from FME and started using Talend since 4th of October, without a course. So bear with me 😉

Issue:

I'm reading a folder where there are 2 files, an XML and a PDF. The XML contains the metadata from that PDF (both have the same name).

Now I'm uploading that PDF with a tFileFetch but I want to pass the metadata directly with that request. Is that even possible with my job?

What I tried:

Changing the order
I've been looking into subJobs but I can't seem to figure it out.
tSetGlobalVar

Here's my job

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Thu, 14 Oct 2021 15:21:52 GMT

Hi @JayQueue,

you can use TSetGlobalVar after the tXMLMAP_1 and change the order of the TReplicate row so the globalvar will be set before you use the tfile fetch

Send me love and kudos

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 06:59:01 GMT

Hello @guenneguez jeremy

I tried that but then the first row is NULL

This is the job:

Changed the Main order behind the Replicate.

Did the mapping with tXMLMap_1

Then set the tSetGlobalVar_1:

I added a tJavaRow in Main order:2 and Main order:1 with

System.out.println("Value of _documentSubject in Main Order:2");

System.out.println(globalMap.get("_documentSubject"));

My output is

Value of _documentSubject in Main Order:2

null

Value of _documentSubject in Main Order:1

Uitgaande facturen Kotee

Value of _documentSubject in Main Order:2

Uitgaande facturen Kotee

Value of _documentSubject in Main Order:1

Uitgaande facturen fin.dienst

So it's starting with Main Order:2!?

That looks weird.

Sending love and kudos

Re: Use variables from one output in another output after replicate

Anonymous — Fri, 15 Oct 2021 07:26:45 GMT

To make sure the job runs in order, i would suggest you to split the job into different subjobs, eg:

tFileList--tIterateToFlow--tHashOutput

|onsubjobok

tHashInput--main--XML file...

|onsubjobok

tHashInput--main--PDF file...

Regards

Shong

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 07:32:35 GMT

If you have difficulty to find hash component :

https://help.talend.com/r/iDUwyneSPUgZVyVcWpVlVw/v0SoaRheiWnba9aPAp21gQ

it's for 6.5 doc but it's the same for 7.3

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 07:34:41 GMT

also when you try to get globalVar it's better to specify the type :

System.out.println((String)globalMap.get("_documentSubject"))

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 07:39:44 GMT

and the gloabalvar can't work if it doesn't used in an iteration for all the flow, the problem here is you directly use iteratetoflow so you're no longer in an iteration.

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 07:39:47 GMT

Hello @Shicong Hong ,

Thanks for the help.

But I can only choose On Component Ok

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 07:40:12 GMT

Thanks @guenneguez jeremy , I found already 🙂

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 07:42:33 GMT

I thought I was in an iteration

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 07:45:42 GMT

use on subjob ok from the tFileList component to the tHashInput

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 08:02:37 GMT

yes but you have to set one globalvar for one pdf so you have to process xml and pdf on the same iteration. here the iteration is only for the xml

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 08:17:00 GMT

so maybe you can do this , filelist on all xml files get the metadata values and the file name.

Stock it into a hash.

Then filelist on all pdf files make a lookup with the hash on the file name to get the pdf fields and metadata fields in the same flow then tFlowToIterate and filefetch

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 08:18:21 GMT

Now I got this:

I need to loop then?

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 08:20:00 GMT

I'll go work this out, tnx:)

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 08:35:20 GMT

also wich values will you stock in the pdf flow ?

cause if it's just filename so after you get the xml file metadata just check if the pdf exist (it's easy if they have the same file name) with a tFileExist and if it's ok filefetch with the values you got.

tFilelist -->iterate -->fileinput XML -->xmlMap--> tSetGlobalVar -->on component ok -->fileExist -->run if fileExist is true and globalvar from xml not null--> tfilefetch

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 09:41:59 GMT

I got it working! Thank you so much.

Here's the solution

Re: Use variables from one output in another output after replicate

gjeremy1617088143 — Fri, 15 Oct 2021 09:47:29 GMT

use a run if link instead of on component ok between fileexist and filefetch, and control the value of the EXISTS var of tFileExist is true and if value of the metadata is not null on the run if link

Re: Use variables from one output in another output after replicate

JayQueue — Fri, 15 Oct 2021 09:48:54 GMT

My bad, it had an If. But had to rebuild my tFetch.

Thanks for noticing!