topic Extract specific data from text file in Talend Studio

Extract specific data from text file

Conkers — Fri, 15 Nov 2024 22:33:02 GMT

I have a text file as follows:

----------------------------------------

ID: 00070

Date: 2022-06-17T09:34:50

Item is now available

Export : 0bf08b33 (2022-06-17T09:35:07) is here -> File D:\PATH\TO\FILE\LOCATION\

----------------------------------------

I'm attempting to export just the ID and the

D:\PATH\TO\FILE\LOCATION\ elements into a table/columns.

Using this workflow, I can extract the relevent rows (beginning 'ID....' & ' Export....')

How would I extract the specific data required from these rows?

Thanks in advance

Conkers

Re: Extract specific data from text file

Anonymous — Thu, 15 Sep 2022 17:00:58 GMT

An easy first change would be to use tFileInputDelimited component. Set the "Field separator" to be ": " (remember the trailing space) and set up two columns. The first one being "RowType" which will hold your row identifier (ID, Date, Item is now available and Export). The second will be your data and will be called "Value". You may want 3rd and a 4th to hold minutes and seconds from the date row, but I guess that these are not necessary.

Once you have this, you can link to a tMap and have a filter on your output table which holds something like this.....

row1.RowType.equals("ID") || row1.RowType.equals("Export ")

This on its own will output this....

ID|00070

Export |0bf08b33 (2022-06-17T09:35:07) is here -> File D:\PATH\TO\FILE\LOCATION\

The pipes above ("|") simply separate the columns. So you have two rows with two columns. Your first row holds your ID value already sorted, the second row has your Export value which will need some further processing.

To do that, further edit the tMap's output table's "Value" column. Replace the row1.Value expression with this....

row1.Value!=null && row1.Value.indexOf("File ")>-1 ? row1.Value.substring(row1.Value.indexOf("File ")+5) : row1.Value

If you run the job again, you will get this.....

ID|00070

Export |D:\PATH\TO\FILE\LOCATION\

I've built a demo job to show you what it looks like. All of the settings I have described.

Re: Extract specific data from text file

Anonymous — Mon, 19 Sep 2022 11:53:27 GMT

I think the best would be to use the following component: https://help.talend.com/r/en-US/8.0/ms-delimited/ms-delimited-scenario

Re: Extract specific data from text file

Anonymous — Mon, 19 Sep 2022 23:49:39 GMT

Good call @Balazs Gunics. I completely forgot to consider the tFileOutputMSDelimited. Thanks for stepping in 👍

Re: Extract specific data from text file

Conkers — Mon, 26 Sep 2022 08:42:54 GMT

Thank you both, I will give tFileOutputMSDelimited a go! (Sorry for not acknowledging sooner, couldn't log in to respond)