topic Re: Writing regular expression in tmap in Talend Studio

Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 06:26:59 GMT

Hi all,

How to write regular expression in tmap.

Source column data.

02 04OCT 10:48:16 220001 .

Output:

col1 col2 col3 col4

02, 04OCT, 10:48:16, 220001

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 08:07:28 GMT

What about doing below?
col1=source_col.split(' ')[0]
col2=source_col.split(' ')[1]
col3=source_col.split(' ')[2]
and so on??

Re: Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 08:27:36 GMT

Hi,

You could use tFileInputRegex or tExtractRegexFields components.

Eric

Re: Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 09:00:39 GMT

Hi @eric44,

i have multiple columns for single file like that, i can't use single tFileInputRegex or tExtractRegexFields components if am correct.

Coulm1 column 2 column 3

02 04OCT 10:48:16 220001 . 13:38:16 220001 220001 12OCT 2.4CR

i need to insert records single records to multiple columns based on regular expression in tmap or substr functions.

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 09:12:24 GMT

Hi @Chirgal,

i am getting error. PFA screen shot for references.

Thanks

Shree

screen shot.png

Re: Writing regular expression in tmap

Anonymous — Tue, 07 Nov 2017 11:36:53 GMT

Please use the below expression for splitting
source_col.split("\\s+")

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 04:17:30 GMT

Hi @Chirgal,

I am facing error.

Source data for single column,
02 2OCT 10:57:37

Expected output:
col1 col2 col3
02 2OCT 10:57:37.

PFA files.

And, Let me clear my requirement.

Source:

Coulm1 column 2 column 3
02 04OCT 10:48:16 220001 . 13:38:16 220001 220001 12OCT 2.4CR

Output:

colu1 col2 col3 col4 col5 col6 col7 col 8 col9

02 04OCT 10:48:16 220001 13:38:16 220001 220001 12OCT 2.4CR

Thanks

Shree

error.PNG
tmap.PNG

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 04:28:45 GMT

Use below expression:
col1=source_col.split("\\s+")[0]
col2=source_col.split("\\s+")[1]

and so on

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 05:53:32 GMT

Hi @Chirgal

Thanks, As per requirement is working fine.

But one issue i am facing. it not handling space or blank..

Source data for single column,
02 2OCT 10:57:37 <space> 20

02 2OCT 10:57:37 23 20

Current output:
col1 col2 col3 col4
02 2OCT 10:57:37. 20

02 2OCT 10:57:37 23

Expected output:

col1 col2 col3 col4 col5
02 2OCT 10:57:37. <space> 20

02 2OCT 10:57:37 20 23

i am attching two records for your references.

Thanks

Shree

saample.txt

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 06:16:44 GMT

Use below expression remove + sign)
col1=source_col.split("\\s")[0]
col2=source_col.split("\\s")[1]

and so on

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 07:30:45 GMT

Hi @Chirgal,

I have tested problem is, the source is coming with single space and multiple space.

So it create mutiple columns unnecessary and some records moving next columns.

Ex:

input:

colun1

12 <space>

13 <space><space> 26

output:

colu1 col2 col3 col4

12 <space>

13 <space> <space> 26

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 08:58:36 GMT

Hi @Chirgal

Any idea on how to over come on issue with multiple space.

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 09:40:03 GMT

Let's try to replace multiple spaces on source:

Try this:

Source_col.trim().replaceAll("\\s+", "\\s");

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 11:29:06 GMT

Hi @Chirgal,

Records are inserting whole column names into single columns.

I am attaching screen shot for references. Kindly help me on this we are near to close issue.

Thanks

Shree

2.PNG
1.PNG

Re: Writing regular expression in tmap

Anonymous — Wed, 08 Nov 2017 14:46:34 GMT

First try to read whole line into single column using TfileInputFullRow.

Then use tmap to replace multiple space to single space. Source_col.trim().replaceAll("\\s+", "\\s");

After that use TExtractDelimitedFields to split the column based on space to multiple columns.

Got some idea?

Sorry. I don't have access to studio. Cant attach job or snaps

Re: Writing regular expression in tmap

Anonymous — Thu, 09 Nov 2017 03:57:13 GMT

Hi @Chirgal,

Sure, TfileInputFullRow ----> tmap --> tfileoutputfiledelimited.

I am getting values multiple space and single space with "s".

Ex:

colu:

02 24OCT 10:57:37

Output:

02s24OCTs10:57:37s4246899014

How to replace "s" wiht space or any other delimiter. Before jumping to TExtractDelimitedFields.

Or, using TExtractDelimitedFields it will handle "s" values between fileds?

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Thu, 09 Nov 2017 04:49:03 GMT

No need to replace. In textractdelimetedfields, use s as delimetre. It will separate column based on s

Re: Writing regular expression in tmap

Anonymous — Thu, 09 Nov 2017 05:39:23 GMT

Hi @Chirgal,

Everything is fine, challenge i am facing column issue. Please check below example.

Ex: Source data

12 <space> 03oct <space>13:21:21 <space> <space> 121212 ...

13 <space> 05oct <space>12:2:11 <space> 0101 <space> 121212 ...

Intermediate result after removing multiple space.

colum1:

12s03octs13:21:21s121212s...

13s05octs12:2:11s0101s121212s...

Current output am getting

col0 col1 col2 col3 .. col4

12 03oct 13:21:21 121212 ...

13 05oct 12:2:11 0101 121212 ...

Expected ouptut

col0 col1 col2 col3 col4

12 03oct 13:21:21 121212 ...

13 05oct 12:2:11 0101 121212 ...

Thanks

Shree

Re: Writing regular expression in tmap

Anonymous — Thu, 09 Nov 2017 09:08:10 GMT

Can you check, if source columns are of fixed width?
Are column starting positions are always same in source file??

Re: Writing regular expression in tmap

Anonymous — Thu, 09 Nov 2017 09:45:11 GMT

Hi Chirgal,

No, If you ask me length of the columns is fixed: No,

i am tried with regex and positional file. it not working as expecting.

Same issue with <space>

Thanks

Shree