Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
fbehfar
Contributor
Contributor

tOracleTableTransfer different parameters

Hi,
I'm using tOracleTableTransfer for loading ~90 big tables, and noticed different speed for 2 tables with similar row counts, and found out the one took longer was due to the big table size!
I tried to play with the "Log interval in seconds", "Source select fetch size" and "Insert Batch size" parameter numbers and hope for the best results but it still taking a very long time for my tables to get loaded! (5 hours for about 90 tables with average row counts of 50K/table)
Does anyone have more depth knowledge on how this perfect custom-made component works?
I have even divided my table list into 2 for relatively large and small tables and gave 50,000 to small ones and 500,000 to large ones for "Source select fetch size" and "Insert Batch size" parameters, but it didn't help with the speed.
Any other idea on how to speed the load up and enhance the performance?
Any help is appreciated!
Labels (2)
21 Replies
Anonymous
Not applicable

I think it has to do with the problem you are trying to use String as transport data type for the column LAST_SERVICE_DATE.
A String must match specific patterns to be accepted as date value in Oracle.
Why do you not able to use Date as type? What happens if you set as data type Date for this column?
What is the original data type of this column in the source database?
fbehfar
Contributor
Contributor
Author

We did 2 rounds of tests.
1. We didn't define any data type in the component, used the default setting, where no data type is being defined. (Can we in this component define the column type specifically?)
2. In the advanced settings we defined "Date" to "timestamp" under custom type mapping.
In both cases we got the same error.
The data type for this column on both source and target is Date.