topic Re: help on tMap in Talend Studio

help on tMap

jip31 — Fri, 15 Nov 2024 22:01:24 GMT

I try to build the job described below

URL

When I run the job, i have no error but also no results!

What is the problem please?

Re: help on tMap

Anonymous — Wed, 08 Mar 2023 07:21:22 GMT

Hi Team,

It says no rows are processed in your job. Can you ensure the schema and schema sync is done correctly? May be you can try without tmap initially and then add tmap for transformation.

Re: help on tMap

jip31 — Wed, 08 Mar 2023 08:20:49 GMT

It's what I done

The schema seems to be correct

It seems there is an issue to parse a field but i dont know how to correct this because Id field exists in my CSV source

Démarrage du Job TMAP2 à 05:59 08/03/2023.

[statistics] connecting to socket on port 3685

[statistics] connected

Couldn't parse value for column 'Id' in 'row1', value is '"1'. Details: java.lang.NumberFormatException: For input string: ""1"

[statistics] disconnected

My original source was this :

Id;Name;Department;StartDate;Salary

1;John Smith;Sales;01-Mar-2023;20000

If I replace Id=1 by Id=x and I replace Id=integer by Id= string, it works

why?

and I have another problem

If I replace ";' by "," , it doesn't works and I have pipe at the end of the output

Démarrage du Job TMAP2 à 10:01 08/03/2023.

[statistics] connecting to socket on port 3908

[statistics] connected

Id Name Department StartDate Salary

"x;John Smith;Sales;01-Mar-2023;20000"||||

"y;JP Ros;Commercial;04-Mar-2023;35000"||||

[statistics] disconnected

Re: help on tMap

Anonymous — Wed, 08 Mar 2023 11:27:02 GMT

Double check your source data, the value is "1, there is a double quote before 1, so it is a string value, you can't use a 'Integer/int' type to read it.

In your source data, the field separator is ";"

Regards

Shong

Re: help on tMap

Informatique1 — Wed, 08 Mar 2023 13:44:31 GMT

Check this options to avoid the double quotes:

Re: help on tMap

jip31 — Wed, 08 Mar 2023 14:52:46 GMT

thanks, it was my issue....

Last question, I need to replace ";" by "|"

So I have done this in the tLogRow connector but the result is not goog because the pipe is put at the end.... (see screen 2)

what is wrong please?

Re: help on tMap

Anonymous — Thu, 09 Mar 2023 01:02:03 GMT

There are 5 fields in your source data, you should define 5 columns on the schema of tFileInputDelimited to map each field, and set the field separator as ";" on tFileInputDelimited.

Re: help on tMap

jip31 — Thu, 09 Mar 2023 06:45:15 GMT

I think it's what I have done

Re: help on tMap

Anonymous — Thu, 09 Mar 2023 07:19:14 GMT

It's strange! Which version of studio are you using? can you try to select 'table' model on tLogRow to check if the data display correctly?

Re: help on tMap

Informatique1 — Thu, 09 Mar 2023 07:33:59 GMT

Screen of your mapping please?

Re: help on tMap

jip31 — Thu, 09 Mar 2023 07:37:00 GMT

Re: help on tMap

jip31 — Thu, 09 Mar 2023 07:40:20 GMT

It's version 8.0.1

here is the table model

Re: help on tMap

Anonymous — Thu, 09 Mar 2023 07:55:16 GMT

please double check the basic settings of tFileInputDelimited, especially the field separator, the component read the whole line as the first column.

Re: help on tMap

jip31 — Thu, 09 Mar 2023 15:26:07 GMT

Sorry i dont understand what you mean

could you write it here please?

Re: help on tMap

Anonymous — Fri, 10 Mar 2023 00:02:55 GMT

I suspect you don't set the right field separator, tFileInputDelimited read the whole line of data as one column, so please double check the field separator.

Re: help on tMap

jip31 — Fri, 10 Mar 2023 10:05:27 GMT

The separator in my csv file is a semicolon so it's normal that I use also a semicolon separator as the field separator in tFileInputDelilited no?

Id;Name;Department;StartDate;Salary

x;John Smith;Sales;01-Mar-2023;20000

Re: help on tMap

jip31 — Sun, 12 Mar 2023 04:22:47 GMT

Is anybody can help please?

Re: help on tMap

Anonymous — Tue, 14 Mar 2023 08:35:41 GMT

I noticed that there is a double quotes around the data,

"Id;Name;Department;StartDate;Salary"

"x;John Smith;Sales;01-Mar-2023;20000"

When the CSV option is checked, the component read the whole line as one value, so just define one column on the schema, and then use a tExtractDelimitedFields to extract each data from the input line, define the all columns on tExtractDelimitedFields.

tFileInputDelimited--main--tExtractDelimitedFields--main--tLogRow

Please try and let me know if it works.

Regardfs

Shong

Re: help on tMap

jip31 — Tue, 14 Mar 2023 09:51:11 GMT

I dont understand anything

In the csv file I sent you, there is no double quotes!

And if i modify the schema like you asked me, I have an error

Re: help on tMap

Anonymous — Tue, 14 Mar 2023 12:29:35 GMT

Open the file with notepad++, you will see the double quotes.

Modify your job to

tFileInputDelimited--main--tExtractDelimitedFields--main--tLogRow