hash file not populating

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
pat_raman2000
Premium Member
Premium Member
Posts: 16
Joined: Tue Apr 17, 2007 12:38 am

hash file not populating

Post by pat_raman2000 »

We are calling datastage job through scripts.oci stage output is connected to hashfile and the hashfile output is used as lookup.What is happening is sometimes hash file is populating and sometimes it is not populating.The server has enough free space.What might be the problem for the strange behaviour.Whether any patch required
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. :D

(The term is "hashed" file, not "hash" file.)

When the hashed file is not populated, what row count is reported through the job? Is there a Transformer stage in the job?

If not, put one in, even though it does nothing. Then you will be able to isolate the problem to "0 rows selected from Oracle" (in which case you would reasonably expect the hashed file not to be populated), or something else.

Let us know how far you get with that, and then we can work out whether any further investigation is needed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pat_raman2000
Premium Member
Premium Member
Posts: 16
Joined: Tue Apr 17, 2007 12:38 am

Re: hash file not populating

Post by pat_raman2000 »

the row count is showing as zero and hash file is connected to transformer stage in the job for lookup .These problem is occuring occasionally only not all the times
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Not the job that does the lookup; the job that populates the hashed file. Is there a Transformer stage between the OCI stage and the hashed file stage in the part that populates the hashed file? If not, put one in.

The most probable cause for not populating the hashed file intermittently is that no rows were selected from Oracle on that run. Putting a Transformer stage between the OCI stage and the hashed file stage will allow that to be proven whenever it next happens.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pat_raman2000
Premium Member
Premium Member
Posts: 16
Joined: Tue Apr 17, 2007 12:38 am

Re: hash file not populating

Post by pat_raman2000 »

The part which populates hash file doesn't have transformer.The oci stage is directly connected to hash file.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

When the hashed file was not populated, how many rows went from the OCI stage to the hashed file? If "0" then you need to look at your database and SELECT statement.
ralleo
Premium Member
Premium Member
Posts: 21
Joined: Mon Dec 11, 2006 9:05 am
Location: London

Post by ralleo »

One other thing you can do is select the option "clear file before write" on the hashed file stage. I believe you have run this many time.

The other thing is to give the hashed file a different name with the "clear file before write" option and see what happens.


Ralleo

The only man who never makes a mistake is the man who never does anything.
.Theodore Roosevelt
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: hash file not populating

Post by ray.wurlod »

pat_raman2000 wrote:The part which populates hash file doesn't have transformer.The oci stage is directly connected to hash file.
I want you to put one in, as an aid to diagnosis.

With two links we get separate counts of rows selected from Oracle table and rows sent to hashed file.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply