A Datastage Job creating an Issue to the entire Database
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 34
- Joined: Tue Dec 27, 2005 12:13 am
A Datastage Job creating an Issue to the entire Database
Hi,
In my Job, I am using two datasets and then Funneling it by a Funnel stage (Funnel Type --- Continous Funnel) and then inserting it into a Db2 Table by using a User defined Update (Giving Insert Staement in User defined Update). Partioning type is Db2.
The Job is running on 4 nodes and one dataset is carrying around 5000 records and the other is carrying 0 records.
Row Commit Interval is 999999
Array Size 999999
The Job is Aborting and the entire database is geeting down because of this Job. Can a Single Job create an Issue to entire Database?
Plz help me to know whats the wrong thing in this Job.
In my Job, I am using two datasets and then Funneling it by a Funnel stage (Funnel Type --- Continous Funnel) and then inserting it into a Db2 Table by using a User defined Update (Giving Insert Staement in User defined Update). Partioning type is Db2.
The Job is running on 4 nodes and one dataset is carrying around 5000 records and the other is carrying 0 records.
Row Commit Interval is 999999
Array Size 999999
The Job is Aborting and the entire database is geeting down because of this Job. Can a Single Job create an Issue to entire Database?
Plz help me to know whats the wrong thing in this Job.
Could you specify exactly what you mean when
? The only possible issue I know is when using the load method you might get the table, and perhaps the tablespace, into a "load pending" or "backup pending" state.the entire database is geeting down because of this Job
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 34
- Joined: Tue Dec 27, 2005 12:13 am
Can you see the possible link between your commit size in the job and the error? If you change your commit frequency down to 50,000 does the error go away (or happen at another point)?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 34
- Joined: Tue Dec 27, 2005 12:13 am
How about approaching your problem one issue at a time. Start with the DB error(s) and see if you still have your job problem. You still haven't shown us an actual error that is locking or stopping the database, just that swap space is full (which isn't a DB/2 issue but a UNIX issue).
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Start with one row per transaction. This should work.
Increase it to 1000. This should work also, since DB2 can easily handle 1000 row transactions.
Ask your DBA whether the database can handle a transaction containing 1 crore records, and be prepared to run for cover!
Increase it to 1000. This should work also, since DB2 can easily handle 1000 row transactions.
Ask your DBA whether the database can handle a transaction containing 1 crore records, and be prepared to run for cover!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 34
- Joined: Tue Dec 27, 2005 12:13 am
[Ask your DBA whether the database can handle a transaction containing 1 crore records, and be prepared to run for cover![/quote]
The Transaction handling depends on the table or the entire database?
If it depends on entire database, then some Jobs are running successfully with transaction containing more than 1 crore records.
The Transaction handling depends on the table or the entire database?
If it depends on entire database, then some Jobs are running successfully with transaction containing more than 1 crore records.
DB/2 has a given amount of space tablespace wide for these transactions, so the number of rows is less important than the size of that data in each row.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 34
- Joined: Tue Dec 27, 2005 12:13 am