Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
dominik4
Contributor
Contributor

slow tDBOutput when loading bigdecimals with decimal point value

Dear Community,

we have the following strange behavior while loading from Oracle to MSSQLServer. Using a simple tDBInput-->tDBOutput. Loading Data with Datatyp <> bigdecimal columns, we have a fast Load (11000 rows/s). Loading with bigdecimal columns but with integer values (like 10,000) , we are fast too. But as soon we have values behind the comma like 10,123 the performance is realy weak (120 rows/s).

Examples:

Price is a column i the table with values like: 99,90

Amount is a number column too, but with no value behind the decimal point like 10,00

 

Load:

Statement -> Schema_in(Oracle)->Talend_intern->Schema_out->DBTableColumn

 

Slow processing:

Select Price from table ->NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(Price as decimal(20,10)) as Price from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

 

Fast processing:

Select amount from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(amount as decimal(20,10)) as amount from table -> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(1 as decimal(20,10)) as Preis-> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

Select cast(123.456 as decimal(20,10)) as Preis-> NUMBER(20,10) -> BigDecimal(20,10) -> DECIMAL(20,10) -> DECIMAL(20,10)

 

I cant understand this behavior? What is the solution? How can i load the price fast too?

 

Thank you

Dominik

Labels (3)
0 Replies