How to capture the rows rejected by DB2 API Stage.
Moderators: chulett, rschirm, roy
How to capture the rows rejected by DB2 API Stage.
Hi,
I read in documentation in DB2/API stage plugin . The rows that are rejected due to unique constraint Violations or Data type mismatches can be captured by setting the Array size to 1 and I made the reject link in transformer and sending to sequential file . But no records are sending to Reject link i.e to sequential file if there is a unique constraint error. In my job Iam using two DB2 API stages one for update and one for insert and then to reject link . Will this work if have two DB2 /API stage. Can any one tell me how to capture rejected rows by DB2/API stage .
Thanks,
Somaraju.
I read in documentation in DB2/API stage plugin . The rows that are rejected due to unique constraint Violations or Data type mismatches can be captured by setting the Array size to 1 and I made the reject link in transformer and sending to sequential file . But no records are sending to Reject link i.e to sequential file if there is a unique constraint error. In my job Iam using two DB2 API stages one for update and one for insert and then to reject link . Will this work if have two DB2 /API stage. Can any one tell me how to capture rejected rows by DB2/API stage .
Thanks,
Somaraju.
somaraju
Hi Kumar,
Please correct me if Iam wrong . Otherwise option is only if the constraint of other link is not satisfied then it goes to this link . I want to catch the records that are failed to insert in to the DB2 table due to any error like DB2 errors and errors that I mentioned above.
Thanks,
Somaraju
Please correct me if Iam wrong . Otherwise option is only if the constraint of other link is not satisfied then it goes to this link . I want to catch the records that are failed to insert in to the DB2 table due to any error like DB2 errors and errors that I mentioned above.
Thanks,
Somaraju
somaraju
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
No reason to use the API stage in parallel jobs, you should be using the enterprise stage instead.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Vincent,
There can be reasons - like in our case, we have our target DB non-partitioned (it's DB2). We cannot use DB2 EE stage unless the database it is pointing to is partitioned. And that's what has been told by IBM support.
There can be reasons - like in our case, we have our target DB non-partitioned (it's DB2). We cannot use DB2 EE stage unless the database it is pointing to is partitioned. And that's what has been told by IBM support.
Nitin Jain | India
If everything seems to be going well, you have obviously overlooked something.
If everything seems to be going well, you have obviously overlooked something.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
DB2API Stage really sluggish
Hi,
I too had some horrible experience with DB2 API stage. I work with DS ver 7x on Unix with DB2 on Mainframe as back end, and thats why forced to use DB2 API stage, but to my disappointment its really slow. Especially at inserting records. Its hardly 500-600 rows per second, which takes hours to complete a job handling 4-5 million records.
I want to get a general conception, is DB2 API stage really that slow ? or my particular environment is sluggish ?
Also I would ask Mr. Somaraju, finally how did he handled the Reject records issue in DB2 API stage. Please share , it will help me a lot.
Regards,
Surojeet
I too had some horrible experience with DB2 API stage. I work with DS ver 7x on Unix with DB2 on Mainframe as back end, and thats why forced to use DB2 API stage, but to my disappointment its really slow. Especially at inserting records. Its hardly 500-600 rows per second, which takes hours to complete a job handling 4-5 million records.
I want to get a general conception, is DB2 API stage really that slow ? or my particular environment is sluggish ?
Also I would ask Mr. Somaraju, finally how did he handled the Reject records issue in DB2 API stage. Please share , it will help me a lot.
Regards,
Surojeet
Surojeet Gantayat
We are never gonna survive...unless we are a litttle crazy !
We are never gonna survive...unless we are a litttle crazy !
surojeet
DB2 API stage is a sequential stage and based on the network bandwith u have betn the mainframe and AIX server, it will further slow it down.
For inserting large volumes of data, it will be faster to FTP the sequential files to the mainframe and load it thru a DB2 load utility, which slams the data into the target table.
we use this process and get to load 2-3 million rows of data in less than 30 minutes.
DB2 API stage is a sequential stage and based on the network bandwith u have betn the mainframe and AIX server, it will further slow it down.
For inserting large volumes of data, it will be faster to FTP the sequential files to the mainframe and load it thru a DB2 load utility, which slams the data into the target table.
we use this process and get to load 2-3 million rows of data in less than 30 minutes.