Missing data

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
springwtr
Participant
Posts: 55
Joined: Tue Feb 07, 2006 5:45 pm

Missing data

Post by springwtr »

I had a job run successfully without any warnings or errors and yet had several records missing in the target table.

We ran the job again and it loaded all the records this time.

Anybody have any idea what could be the cause?

Thanks,
Spring
anbu
Premium Member
Premium Member
Posts: 596
Joined: Sat Feb 18, 2006 2:25 am
Location: india

Post by anbu »

Are you using insert/update on loading target table?

Check your constraints in transformer if you have.
Last edited by anbu on Mon Feb 08, 2010 11:38 am, edited 1 time in total.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Details, please.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What tool were you using to inspect the target?

Moderator: please move to server forum
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
springwtr
Participant
Posts: 55
Joined: Tue Feb 07, 2006 5:45 pm

Post by springwtr »

Job uses Truncate and reload. Don't have any constraints in transformer other than doing lookup's.

We are using sql to compare source row count vs target row count.

we are running 3 different jobs inside single sequence in parallel with no connections or dependancy among these.

Seq looks like:

A job------>B job
G job------>H job
X job------>Y job

That's it.

The source data comes from different sources for all three jobs.
IN the above seq, A is a stored procedure that should be completed to run job B.
X is a sub sequence of multiple jobs to be completed before running job Y.

Wondering if it is ok to run these different jobs in same seq
Would that cause any DB contention.

Thanks,
Spring
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Are you truncating the target in all the jobs ?

Try writing to individual sequential files to check the output.
Jai_sahaj
Participant
Posts: 7
Joined: Mon Nov 10, 2003 1:11 pm

Post by Jai_sahaj »

It looks like a timmings issue to me. Most probably the lookup data is not available when you are running it first time but becomes available when you run it again. Check the dependency with jobs creating the lookup data.
JP
springwtr
Participant
Posts: 55
Joined: Tue Feb 07, 2006 5:45 pm

Post by springwtr »

Hmmm....I did not have to run the Dimensions.
Just reran the fact jobs and it loaded all the records the second time.
Post Reply