topic Re: OutputStream with tAdvancedFileOutputXML in Talend Studio

OutputStream with tAdvancedFileOutputXML

Anonymous — Sat, 16 Nov 2024 12:42:09 GMT

Hi,
Can anybody explain how to use the option "Use output Stream"? what's the component used for this option?
Thanks in advance...
Ganesh.S

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Wed, 07 Sep 2011 03:22:07 GMT

Hi
Use the Java object FileOutputStream have already been defined on previous component as the file path, please see my screenshots.
Best regards
Shong

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Thu, 13 Nov 2014 05:37:05 GMT

Hi Shong,
I dont find any screenshots for this outputstream usage in tAdvancedFileOutputXML. Kindly help

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Thu, 13 Nov 2014 10:03:05 GMT

Hi sairamkumar,
Please see my screenshot
Best regards
Sabrina

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Thu, 13 Nov 2014 10:17:14 GMT

Hi Sabrina,
My scenario is this.
Have a multischema complex with below structure. Able to generate the XML using tFileOutputMSXML. But it takes more than 30 minutes to generate. Hence trying to do the same with tAdvancedFileOutputXML by using Append the source XML. Not able to do it because there is no id at group level hence it replaces the content.
Queries:
1. How to speed up my XML generation using tFileOutputMSXML?
2. How to generate below complex XML using tAdvancedFileOutputXML?
Ideally my aim is to generate multischema at high speed.

<Msg>
<hd>
<id>1</id>
</hd>
<videos>
<base>b1</base>
<video> - complex and repeats for 50,000 iterations
<id>1</id>
<url>site1</url>
...
</video>
<video>
<id>2</id>
<url>site2</url>
...
</video>
</videos>
<Images>
<base>b1</base>
<Image> - complex and repeats for 50,000 iterations
<id>1</id>
<url>site1</url>
...
</Image>
<Image>
<id>2</id>
<url>site2</url>
...
</Image>
</Images>
</Msg>

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Thu, 13 Nov 2014 10:34:35 GMT

Hi sairamkumar,
What's your Input source? and how large? Could you please share your current work flow screenshot with us?
Best regards
Sabrina

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Thu, 13 Nov 2014 10:45:36 GMT

Hi,
Screenshot attached. This is my job using tFileOutputMSXML component and it is slow.
Table 1 fetch is the entry point in the job.

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Mon, 17 Nov 2014 08:23:59 GMT

Hi,
You can use append feature on tAdvancedFileOutput instead of tFileOutputMSXML.
Please have a look at KB article:TalendHelpCenter:Append the source xml file feature
Best regards
Sabrina

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Wed, 26 Nov 2014 08:11:41 GMT

Hi,
I tried to do using tAdvancedFileOutputXML. It is taking more time than tFileOutputMSXML.
Kindly help to get a solution for this. We are using Talend enterprise version and still not able to improve the performance for XML generation.

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Wed, 26 Nov 2014 09:03:00 GMT

Hi sairamkumar,
What's the job rate when you were using tAdvancedFileOutputXML?

Best regards
Sabrina

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Wed, 26 Nov 2014 10:23:42 GMT

Hi,
By using tAdvancedFileOutputXML, it is taking 13.64 minutes for generating an XML of size 200 MB with 100,000 iterations.

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Sun, 30 Nov 2014 15:51:56 GMT

Hi,
Actually, it is a normal rate. Could you share us your whole job flow screenshot so that we can see if there is any improvement in your job design.
Best regards
Sabrina

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Mon, 01 Dec 2014 04:37:28 GMT

Hi,
Screenshots of the job is attached. First one is the complete screenshot of the job. Second one is the cursor size set for the database fetch component. Please check and revert on any improvements possible.

Re: OutputStream with tAdvancedFileOutputXML

Anonymous — Wed, 03 Dec 2014 01:58:18 GMT

Hi,
Please respond for my query.