Issue in record Extraction

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ag_ram
Premium Member
Premium Member
Posts: 524
Joined: Wed Feb 28, 2007 3:51 am

Issue in record Extraction

Post by ag_ram »

Hi Folks

Facing a strange problem , extracting data from z/os - DB2 . Link counts show 10000 records and view data shows 10000 , actual dump into a dataset has only 100 records immaterial of data extracted !
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

How are you determining the number of rows in the Data Set?

What else is happening in the job design? Is there anything at all in the job design that might prevent records from being passed through? Is the job compiled in trace mode?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ag_ram
Premium Member
Premium Member
Posts: 524
Joined: Wed Feb 28, 2007 3:51 am

Post by ag_ram »

Hello Ray

I am using DataSet-Management utility to read the dataset and the no:of records in each node.
There are no other stages in the Job , it is just a dump of the table we are taking for processing in the subsequent Jobs.
Job is compiled normally not in trace mode
Last edited by ag_ram on Thu Jul 19, 2007 10:32 pm, edited 1 time in total.
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Is there any warning in the log?
ag_ram
Premium Member
Premium Member
Posts: 524
Joined: Wed Feb 28, 2007 3:51 am

Post by ag_ram »

NO Warnings / Errors in the log
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Are you sure that you are looking at the actual record counts and not some limit placed by the "view data" in the Data Set Management tool?
sas
Charter Member
Charter Member
Posts: 13
Joined: Sun Mar 05, 2006 12:37 am

Post by sas »

Create a small dummy job to read the same dataset instead of reading from Data Set Management tool.
sas
Charter Member
Charter Member
Posts: 13
Joined: Sun Mar 05, 2006 12:37 am

Post by sas »

Create a small dummy job to read the same dataset instead of reading from Data Set Management tool to check how many records are being read.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I like using the command line tool orchadmin ll {dataset} ; that gives me the number of records per partition, total bytes, etc.

You could try

Code: Select all

orchadmin dump {DataSet} | wc -l
to get a 2nd opinion on the number of the records in the dataset.
ag_ram
Premium Member
Premium Member
Posts: 524
Joined: Wed Feb 28, 2007 3:51 am

Post by ag_ram »

HI Folks

Tried both ! Still remains unresolved though . :?
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Try writing to sequential file instead of dataset.
ag_ram
Premium Member
Premium Member
Posts: 524
Joined: Wed Feb 28, 2007 3:51 am

Post by ag_ram »

No still does not work Still :?
JeroenDmt
Premium Member
Premium Member
Posts: 107
Joined: Wed Oct 26, 2005 7:36 am

Re: Issue in record Extraction

Post by JeroenDmt »

Did you check the data in DB2? Is 10000 the correct number, or are the 100 records that you are getting, the correct result?
Post Reply