PX Routines

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
thumsup9
Charter Member
Charter Member
Posts: 168
Joined: Fri Feb 18, 2005 11:29 am

PX Routines

Post by thumsup9 »

Hi,

I have a situation where a job design has data transferred into a staging area.We use a shared container where we have the logic for the rowcount on the records.This Shared container is used inmany other jobs.
Now I would like to know,if a Buildop or Px routine is better than a shared container,which to me seems right.If yes,can you suggest me how we can approach this.Or is there any other way around which isnt striking me,as its only the rowcount logic involved.

Thanks,
Thums
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

I think it is better to do row counting after the job has finished. Trying to embed row counting into the job only slows it down and adds a development and maintenance overhead. There are plenty of ways to do row counts, see the FAQ forum thread on DataStage reporting options such as MetaStage and ETLStats.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I agree 100% with Vincent on this one. Remember the adage about performance; measurement should have minimal impact on the object being measured.
DataStage preserves the link row counts, so there's no good reason to be interrupting its real processing to enquire while the job is running. Do it afterwards!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
jasper
Participant
Posts: 111
Joined: Mon May 06, 2002 1:25 am
Location: Belgium

Post by jasper »

I use an after routine for this. most important statement in this:

Code: Select all

 CountRows = DSGetLinkInfo(DSJ.ME, Stage, Link, DSJ.LINKROWCOUNT)
.

This gives you the number rows that were processed on this one link in a stage.
thumsup9
Charter Member
Charter Member
Posts: 168
Joined: Fri Feb 18, 2005 11:29 am

Post by thumsup9 »

Thanks All, I will test based on your suggestions and get back to you with the results.
Post Reply