Problem with Merge Stage

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
LRenwick
Participant
Posts: 5
Joined: Fri Aug 26, 2005 9:02 am
Location: London, UK

Problem with Merge Stage

Post by LRenwick »

Hello,

I'm getting a problem with a job that starts with a merge stage.
The Merge is on 2 text files that are created by other jobs run earlier in a sequence.
The 2 text files exist and contain the appropriate data.

The error appears in the log as follows:
Event: Starting Job PIniMedStage4.1. (...)
Event: Environment variable settings: (...)
Event: PIniMedStage4.1.SRT_o_med_date: DSD.StageRun Active stage starting, tracemode = 0.
Event: PIniMedStage4.1.MERGE_Input: Seek failed
Event: PIniMedStage4.1.MERGE_Input: Function 'put_row_to_page' failed
Event: PIniMedStage4.1.MERGE_Input: Function 'construct_hash_table' failed
Event: Attempting to Cleanup after ABORT raised in stage PIniMedStage4.1.MERGE_Input
Event: Job PIniMedStage4.1 aborted.
Event: (PIniMedSeq) <- PIniMedStage4.1: Job under control finished.


Any ideas how to address this? I can't find anything useful in the online help.

Any help will be much appreciated.

Thanks,
Louise.
elavenil
Premium Member
Premium Member
Posts: 467
Joined: Thu Jan 31, 2002 10:20 pm
Location: Singapore

Post by elavenil »

What is the join operation that you are doing in the Merge stage.

It seems to me, key columns in the input/output having null values so pls check the key columns in the input whether they have null values.

HTWH.

Regards
Saravanan
LRenwick
Participant
Posts: 5
Joined: Fri Aug 26, 2005 9:02 am
Location: London, UK

Post by LRenwick »

Saravanan, Thanks for the quick response!

The join is a "Pure Inner Join".
I have checked the files and there are no nulls in the key column in either file.
elavenil
Premium Member
Premium Member
Posts: 467
Joined: Thu Jan 31, 2002 10:20 pm
Location: Singapore

Post by elavenil »

Can you check the non-nullable column values, whether they contain null values. This error is causing somewhat related to NULL handling in any one of the file if my memory works correctly.

Check column metadata in the input and output whether they have same nullablity property set.

Regards
Saravanan
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi,
From my experiance with this stage, If you made any changes and then had strange problems you better rebuild it from scrtch and it usually works.
IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
LRenwick
Participant
Posts: 5
Joined: Fri Aug 26, 2005 9:02 am
Location: London, UK

Post by LRenwick »

Saravanan
There is one column that has null values and it is set to nullable everywhere it appears.

Roy
This is a job that was built by a contractor who was brought in to work on a number of things and has never been tested up to now, so as far as I know, it has never worked.
I tried rebuiding the merge stage anyway and have recompiled and re-run to no effect.


I'll keep working on it. I've raised a call with the helpdesk too. I'll report back if I get a resolution.
LRenwick
Participant
Posts: 5
Joined: Fri Aug 26, 2005 9:02 am
Location: London, UK

Post by LRenwick »

According to Ascential, this is a bug in v6.0.1 which is fixed in v6.0.2 and all later releases. Can you guess which version I am working with?

I have found a workaround though. I've replaced on the of the sequential files with a hash file and am using a lookup to combine the 2 sets of data. Not as neat as using merge would have been, but at least it works!

Thanks for your help and advice.

Louise.
PhilHibbs
Premium Member
Premium Member
Posts: 1044
Joined: Wed Sep 29, 2004 3:30 am
Location: Nottingham, UK
Contact:

Post by PhilHibbs »

LRenwick wrote:I have found a workaround though. I've replaced on the of the sequential files with a hash file and am using a lookup to combine the 2 sets of data. Not as neat as using merge would have been, but at least it works!
Louise.
In our experience, the Merge stage (even in 7.0.1) is to be avoided as it brings nothing but pain. If you are doing a many-to-many join, or a full outer join, then there isn't much other choice that doesn't bring severe complexity or performance penalties though.
Phil Hibbs | Capgemini
Technical Consultant
Post Reply