Redbrick Bulk Loader
Posted: Sat Jan 15, 2005 12:11 am
I am using Redbrick Bulk load(TMU Utility) to update 900,000 records. The source is sequential file and has three columns one is primary key of the target table and other two is the columns needed to be updated.
The existing table has 4,500,000 records and one of the column which is updated has Btree index on the table. The problem now I am facing is this job takes ever to run. This job is running for more than 24 hrs and nothing happened. The tmu log shows the job is running and in the database I can see the command load data in the dst_commands. When I looked at the locks it shows all the other tables which is referenced by this table.
As a work around we tried using the tmu command manually and splitted the 900,000 records into 200,000 chunck. We started the first set of 200,000 records last night and it got finished after 12 hours.
Did anyone faced this type of problem. Is something need to be tunned?....
The existing table has 4,500,000 records and one of the column which is updated has Btree index on the table. The problem now I am facing is this job takes ever to run. This job is running for more than 24 hrs and nothing happened. The tmu log shows the job is running and in the database I can see the command load data in the dst_commands. When I looked at the locks it shows all the other tables which is referenced by this table.
As a work around we tried using the tmu command manually and splitted the 900,000 records into 200,000 chunck. We started the first set of 200,000 records last night and it got finished after 12 hours.
Did anyone faced this type of problem. Is something need to be tunned?....