slow tDBOutput when loading bigdecimals with decimal point value

dominik4 — Sat, 16 Nov 2024 00:46:38 GMT

Dear Community,

we have the following strange behavior while loading from Oracle to MSSQLServer. Using a simple tDBInput-->tDBOutput. Loading Data with Datatyp <> bigdecimal columns, we have a fast Load (11000 rows/s). Loading with bigdecimal columns but with integer values (like 10,000) , we are fast too. But as soon we have values behind the comma like 10,123 the performance is realy weak (120 rows/s).

Examples:

Price is a column i the table with values like: 99,90

Amount is a number column too, but with no value behind the decimal point like 10,00

Load:

Statement -> Schema_in(Oracle)->Talend_intern->Schema_out->DBTableColumn

Slow processing:

Select Price from table ->NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(Price as decimal(20,10)) as Price from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Fast processing:

Select amount from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(amount as decimal(20,10)) as amount from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(1 as decimal(20,10)) as Preis-> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(123.456 as decimal(20,10)) as Preis-> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

I cant understand this behavior? What is the solution? How can i load the price fast too?

Thank you

Dominik

topic slow tDBOutput when loading bigdecimals with decimal point value in Talend Studio

slow tDBOutput when loading bigdecimals with decimal point value