Bulk Load Option for DB2 Connector Stage
Posted: Wed Jun 08, 2011 12:45 am
Hi we are using DS 8.1
We able to execute bulk load using DB2 Connector only for less volume of records.
It breaks when volume is huge.
Bulk load also takes more time compared to Normal insert. I have set Non recoverable load to YES.
Normal insert: 189K records: 3:44 mins
Bulk load: 80K records: 1:13 hrs
Bulk load: 189K records: Aborted
Below are the error messages we got
dbeW_Sales_Cost_Planning,0: [IIS-CONN-DB2-000314] The DB2 Load API call failed with SQLCODE -30,081.
dbeW_Sales_Cost_Planning,0: [IIS-CONN-DB2-000299] An error occurred in the thread for loading data. (CC_DB2APILoadRecordDataSetConsumer::processOneTopLevelDataItem, file CC_DB2APILoadRecordDataSetConsumer.cpp, line 1,881)
I was working with bulk load for full volume in dev and was failing repeatedly In development environment the jobs are aborting for huge volume which the normal insert is able to handle effectively. Ideally bulk load should be much faster if it is preferred load method. Can any of you help me in understanding why DB2 connector stage with bulk load fails for huge volume?
We able to execute bulk load using DB2 Connector only for less volume of records.
It breaks when volume is huge.
Bulk load also takes more time compared to Normal insert. I have set Non recoverable load to YES.
Normal insert: 189K records: 3:44 mins
Bulk load: 80K records: 1:13 hrs
Bulk load: 189K records: Aborted
Below are the error messages we got
dbeW_Sales_Cost_Planning,0: [IIS-CONN-DB2-000314] The DB2 Load API call failed with SQLCODE -30,081.
dbeW_Sales_Cost_Planning,0: [IIS-CONN-DB2-000299] An error occurred in the thread for loading data. (CC_DB2APILoadRecordDataSetConsumer::processOneTopLevelDataItem, file CC_DB2APILoadRecordDataSetConsumer.cpp, line 1,881)
I was working with bulk load for full volume in dev and was failing repeatedly In development environment the jobs are aborting for huge volume which the normal insert is able to handle effectively. Ideally bulk load should be much faster if it is preferred load method. Can any of you help me in understanding why DB2 connector stage with bulk load fails for huge volume?