Can any one please tell me how to run more than 1 job at the same time to load into a table.
thanks
aschand
Run more than 1 job at same time
Moderators: chulett, rschirm, roy
Jobs are started from the director or command line, so it is a simple matter to start several at the same time; or make one multi-instance and start several parallel runs of the same job.
The difficulty lies in creating the job(s) so that no locking or other problems occurs and from you post it isn't clear which of these two components you have questions about.
The difficulty lies in creating the job(s) so that no locking or other problems occurs and from you post it isn't clear which of these two components you have questions about.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Can all three jobs be affecting the same rows? If so, how will you want to handle that? Doesn't one job have a higher priority that another when manipulating a particular row?
What about database locking or contention? What about updates and deletes? What about surrogate key assignments? What about data volume and bandwidth, will you have the capacity to be executing three simultaneous jobs if each job is tuned to maximize hardware resources?
What about database locking or contention? What about updates and deletes? What about surrogate key assignments? What about data volume and bandwidth, will you have the capacity to be executing three simultaneous jobs if each job is tuned to maximize hardware resources?
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Aschand,
Below are the default option for most of the databases.
When you try to 'LOAD' into database an exclusive lock will be made on the tables to maintain the data integrity.
But, you can make a SELECT statement while the data is getting loaded into database.
Now, its logical that this is the limitation of the databases and not DataStage may not do any magic.
Below are the default option for most of the databases.
When you try to 'LOAD' into database an exclusive lock will be made on the tables to maintain the data integrity.
Code: Select all
INSERT, UPDATE or DELETE's - will place a ROW EXCLUSIVE lock.
SELECT...FROM...FOR UPDATE - will place a ROW EXCLUSIVE lock
Now, its logical that this is the limitation of the databases and not DataStage may not do any magic.
Thanks and Regards!!
dspxlearn
dspxlearn
-
- Participant
- Posts: 80
- Joined: Fri Aug 21, 2009 7:49 am
- Location: India
Run more than 1 job at same time
hi,
we faced the similar issue when we tried to load data into oracle db with Oracle Enterprise stage through 6parallel jobs running parallel in a sequence. We were getting the error 'resource busy and acquire with NOWAIT specified'. The properties in the oracle enterprise stage was
Write Method = Load
Write Mode = Append
For this we found a work around where we have given an alter command in the orcale enterprise stage under options
Open Command = alter session enable parallel DML
not sure if this might be the solution for the problem but we are not facing the issue now when trying to load data into that table.
we faced the similar issue when we tried to load data into oracle db with Oracle Enterprise stage through 6parallel jobs running parallel in a sequence. We were getting the error 'resource busy and acquire with NOWAIT specified'. The properties in the oracle enterprise stage was
Write Method = Load
Write Mode = Append
For this we found a work around where we have given an alter command in the orcale enterprise stage under options
Open Command = alter session enable parallel DML
not sure if this might be the solution for the problem but we are not facing the issue now when trying to load data into that table.