DSXchange

Thanks Bland, The table has like 64 fields averaging char size of 7 I am selecting only 10 fields out of this But this is a join between three tables The other two tables are smaller I restarted the job again and it seems to be running fine till now (24M records processed till now, got another 1.5M ...

Hi Am not an expert but just trying to understand ODBC stage is suppose to be slower I am not sure why you are using a Hash file unless if you are doing a lookup I would rather use a sequential stage Again the before/after job subroutine wont be affected by row buffering I may be wrong I will let th...

Hi -

I did use cleanup resources
I did use kill -9
i also tried using DS.TOOLS but dont know how far I did it right
But still some of my jobs and the table definition are locked

I didn't find any Phanton on these jobs

What else can I do?

Kishan

Thanks again

I am using these numbers
one job just reading from the table and writing in a sequential file
Array Size = 5000

the jobs that update the same table
Input-- Array Size 5000
Output -- Array Size 3000, Transaction Size 3000, and rows per transaction 3000


kishan

Thanks Trokosz,

Before I go to the DBA, is there any problem with the Array Size, Transaction Size and the Rows per transaction size?


Thanks again
Kishan

Thanks ArnDw, This huge data volume is making me learn a lot of stuff I just restarted the sequence Now I am just reading in this job i removed the update job as it has already finished successfully Then again i am doing updates in the later job but all the data are coming from a sequential file So ...

Hi I read all the 11 posts about this problem ORA-01555: snapshot too old: rollback segment number 4 with name "RBS03" too small I am running 2 jobs in parallel Both reading from the same table one job just reading from the table and writing in a sequential file Array Size = 5000 Second re...

Hi everybody, help me with this when I use this command in the before job subroutine Executed command: sort -t'|' -u -T tmpdirectory -k1,1 -k2,2 -k3,3 -k4,4 -k5,5 file1 file2 file3 file3 > outfile I get the error message Row out of sequence At row 13990, link "input" Row out of sequence Bu...

Thanks Chulett,

This means should I give the sort order in the input of the aggregator stage again .

If i dont give that order, it will go ahead sort it again

Thanks

Kishan

Hello again, I started this issue in a previous post but the problem is little differnt from where i started So I am posting a new one I used -n option in the sort, it worked That is for a small dataset When I ran it for bigger dataset. I am getting this error ds_ipcgetnext - timeout waiting for mut...

Ray -

I added the -n option
It makes sense
I thought it to be something different

The job finished successfully

Thanks everybody

Kishan

Well Arndw,

The output from aggregator has 5 fields
I am dropping one field
I am renaming one of the field
Adding one column to populate with 'Y'

These are direct maps

I am not doing anything else in the transformer

Kishan

Thanks Ray,

2 of the field are char, 1 varchar, and 2 number and still i need to give the -n option
Does it make sense to sort again in the aggregator stage?

Thanks again

Kishan

Hi I changed the job to see if all the data is going correct Now instead of updating to the Table, i just loaded to a sequential file I found something strange The number rows coming into the Aggregator is 12814 The number of rows going out of the Aggregator is 12054 This is a direct map from the ag...

Hi everybody, In one of my job, I am getting data from sequential file and using aggregator stage to get the min of a group of values and transformer to update a table using OCI stage. 4 sequential files are merged and sorted to feed the sequential using before-job sub-routine ExecSH command The job...