Hi,
I have a situation where a job design has data transferred into a staging area.We use a shared container where we have the logic for the rowcount on the records.This Shared container is used inmany other jobs.
Now I would like to know,if a Buildop or Px routine is better than a shared container,which to me seems right.If yes,can you suggest me how we can approach this.Or is there any other way around which isnt striking me,as its only the rowcount logic involved.
Thanks,
Thums
PX Routines
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
I think it is better to do row counting after the job has finished. Trying to embed row counting into the job only slows it down and adds a development and maintenance overhead. There are plenty of ways to do row counts, see the FAQ forum thread on DataStage reporting options such as MetaStage and ETLStats.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I agree 100% with Vincent on this one. Remember the adage about performance; measurement should have minimal impact on the object being measured.
DataStage preserves the link row counts, so there's no good reason to be interrupting its real processing to enquire while the job is running. Do it afterwards!
DataStage preserves the link row counts, so there's no good reason to be interrupting its real processing to enquire while the job is running. Do it afterwards!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
I use an after routine for this. most important statement in this:
.
This gives you the number rows that were processed on this one link in a stage.
Code: Select all
CountRows = DSGetLinkInfo(DSJ.ME, Stage, Link, DSJ.LINKROWCOUNT)
This gives you the number rows that were processed on this one link in a stage.