Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Save $650 on Qlik Connect, Dec 1 - 7, our lowest price of the year. Register with code CYBERWEEK: Register
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Really Slow load from Informix Database (version 7.3)

Hello!

 

I would like help with a really big problem that I am facing right now, I have load data from an Informix database but Talend can't load more than 70 rows per second, if I try to load in this same database from Excel or Qlik I can read it at least 8 x faster.

 

Could someone help me with that?

0683p000009M3oD.png

Labels (2)
16 Replies
Anonymous
Not applicable
Author

Could you share your schema? Maybe I am get a wrong data type. What's is your jbdc driver version ?
I
vapukov
Master II
Master II

I just create and populate table with 1M rows, as you describe:

- serial - primary key

- integer - random

- integer random

- varchar - 255 char random 

 

and use standard talend components - int, int, int, string

 

0683p000009M4kF.png

Anonymous
Not applicable
Author

It is wired I have used the same data types as you.....
In the same server I have different performance to load the data depends on the tool.
I really don't know how fix it...
Maybe the version of the informix 7.3
vapukov
Master II
Master II

yes, it could be and settings and version (I have the latest) and network - my is local 1Gb network 

Anonymous
Not applicable
Author

I have the database In the same network, i don't believe this is the reason...
As I said before, the wired thing is I have a good performance In the same table delwnd the field I retrieve
Anonymous
Not applicable
Author

I have tested with Pentaho and get better performance, but I would like to do it in Talend, someone I am convinced that the problems are about the Data formating between Talend and Informix
Anonymous
Not applicable
Author

The problem was the limitation from Informix to retrieve the data, you have to set the variable FET_BUF_SIZE to improve the performance. more details here
https://community.talend.com/t5/Design-and-Development/Problems-to-connect-Informix/m-p/159228#M9718...

I really thanks to @vapukov