Hi everybody,
In one of my job, I am getting data from sequential file and using aggregator stage to get the min of a group of values and transformer to update a table using OCI stage. 4 sequential files are merged and sorted to feed the sequential using before-job sub-routine ExecSH command
The jobs worked fine for small dataset, i ran the job for the whole dataset, the job aborted with mutex error
So i removed the duplicates while sorting the data for sequential file
I ran the job again, now it finished the job but the update statement was not found in the log.This job also ended much faster but found so many rows not being updated
Can someone explain me this?
Thanks
Kishan
Can
OCI Stage acting wierd
Moderators: chulett, rschirm, roy
Hi
I changed the job to see if all the data is going correct
Now instead of updating to the Table, i just loaded to a sequential file
I found something strange
The number rows coming into the Aggregator is 12814
The number of rows going out of the Aggregator is 12054
This is a direct map from the aggregator to the sequetial file through a transformer with 2 extra fields added
The output of the transformer has 13180 rows
The job aborted with the message
Also i am sorting the input in the aggregator in the same order 1 , 2 and 3
Why am i getting this error
Help me with this
Thanks
Kishan[/quote]
I changed the job to see if all the data is going correct
Now instead of updating to the Table, i just loaded to a sequential file
I found something strange
The number rows coming into the Aggregator is 12814
The number of rows going out of the Aggregator is 12054
This is a direct map from the aggregator to the sequetial file through a transformer with 2 extra fields added
The output of the transformer has 13180 rows
The job aborted with the message
i am using sort command in the before job subrouitingAt row 13990,Row out of sequence message
Code: Select all
sort -t'|' -u -T #tempDirectory# -k1,1 -k2,2 -k3,3 file1 file2 file3 file4 > outfile
Why am i getting this error
Help me with this
Thanks
Kishan[/quote]
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: