Page 1 of 1

Missing data

Posted: Mon Feb 08, 2010 11:25 am
by springwtr
I had a job run successfully without any warnings or errors and yet had several records missing in the target table.

We ran the job again and it loaded all the records this time.

Anybody have any idea what could be the cause?

Thanks,
Spring

Posted: Mon Feb 08, 2010 11:37 am
by anbu
Are you using insert/update on loading target table?

Check your constraints in transformer if you have.

Posted: Mon Feb 08, 2010 11:37 am
by chulett
Details, please.

Posted: Mon Feb 08, 2010 3:56 pm
by ray.wurlod
What tool were you using to inspect the target?

Moderator: please move to server forum

Posted: Mon Feb 08, 2010 11:00 pm
by springwtr
Job uses Truncate and reload. Don't have any constraints in transformer other than doing lookup's.

We are using sql to compare source row count vs target row count.

we are running 3 different jobs inside single sequence in parallel with no connections or dependancy among these.

Seq looks like:

A job------>B job
G job------>H job
X job------>Y job

That's it.

The source data comes from different sources for all three jobs.
IN the above seq, A is a stored procedure that should be completed to run job B.
X is a sub sequence of multiple jobs to be completed before running job Y.

Wondering if it is ok to run these different jobs in same seq
Would that cause any DB contention.

Thanks,
Spring

Posted: Tue Feb 09, 2010 5:37 am
by Sainath.Srinivasan
Are you truncating the target in all the jobs ?

Try writing to individual sequential files to check the output.

Posted: Tue Feb 09, 2010 6:21 am
by Jai_sahaj
It looks like a timmings issue to me. Most probably the lookup data is not available when you are running it first time but becomes available when you run it again. Check the dependency with jobs creating the lookup data.

Posted: Tue Feb 09, 2010 10:28 am
by springwtr
Hmmm....I did not have to run the Dimensions.
Just reran the fact jobs and it loaded all the records the second time.