best way to delete

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sheema
Premium Member
Premium Member
Posts: 204
Joined: Sat Jul 22, 2006 10:20 am

best way to delete

Post by sheema »

Hi,

We have a table which has more than 100 million rows (Oracle),we get a weekly file of around 30 million rows.Our requirement is to see if there are any rows from the file which exist in the table and delete them.Delete is done depending on the key columns.Which would be a better approach to do this.
I have tried reading the file and delete rows by selecting Write Method of Delete rows in Oracle Enterprise stage,but it is very slow.Is there a better way of deleting the records.

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No, given that the delete is conditional.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

What percentage of the 30M will be deletes? It could conceivably be more efficient to rebuild the table, copying over only the records to be kept. Then rename the tables to swap the new for the old.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply