topic performance between RegEx and TFileInputDelimited in Talend Studio

performance between RegEx and TFileInputDelimited

Anonymous — Sat, 16 Nov 2024 14:28:39 GMT

I found that tFileInputRegex is better than a tFileInputDelimited to do a join.
i don't understand why it's better. Is it always true or not ?

Re: performance between RegEx and TFileInputDelimited

Anonymous — Thu, 24 Jan 2008 19:29:05 GMT

Hello,
Do you mean that tFileInputRegex is faster than tFileInputDelimited ?
Regular expressions are pretty fast, but it also depends on various proerty like options selected in your tFileInputDelimited, your keys, your data types and on your files.
You post seems interesting, what is the gap between the two jobs ?
Regards,

Re: performance between RegEx and TFileInputDelimited

Anonymous — Fri, 25 Jan 2008 12:56:38 GMT

i have same structure on two components and time is better for x4 with RegEx.

Re: performance between RegEx and TFileInputDelimited

Anonymous — Mon, 28 Jan 2008 12:45:20 GMT

With your regular expression, we can see that you don't use the CSV options.
This option is really time-consuming.
You should deactivate it to accelerate your tFileInputDelimited components.
Regards,

Re: performance between RegEx and TFileInputDelimited

Anonymous — Mon, 04 Feb 2008 12:49:50 GMT

I test without csv option and now job is done in 13 minutes (20 minutes before). It's better but not really very good because there's only 1 million lines.

Re: performance between RegEx and TFileInputDelimited

Anonymous — Tue, 05 Feb 2008 22:30:47 GMT

Can you post your final job ?