I have some problem about connect with db2 because I use odbc connect and Load Data about 17 million record about 4 hour systm failo and errror message "ODBC read fail" . how do i in this case ?
I'm guessing that you are reading the data from AS/400 (or mainframe, or AIX box?) There should be a few things to try, especially if it's AS/400:
- Check the job logs to understand the specific issue. You might be running out of the limits that have been set for a single job, for example...
- Have the System Administrator check the amount of resources that's allocated to the subsystem that ODBC is running under (typically this subsystem called QCMN, but it can be changed). Many times, this subsystem is being forgotten and stuck with very limited resources.
- Try different settings in your ODBC Data Source definitions. Specifically, under Performance-Advanced, there is a setting for the block size. By default, it's very small (like 32K), and that's why the load is taking so long (I think 4 hours is too long, even for 17 Mil. rows). You can try increasing it to 1 MB or 2 MB. The maximum is 8 MB, but you might run into some sporadic problems if the block size it set too high.
- Finally, you can try slicing your data into pieces (for example, loading annual chunks or monthly chunks at a time) and storing your data into QVD files. Make sure that once you load your 17 Mil. rows, you never need to go back to DB2 to get them again, except for loading new data incrementally.
