How to capture no of rows processed on link in parallel job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You'll find that basically every DS API function has an equivalent from the command line via dsjob.
-craig

"You can never have too many knives" -- Logan Nine Fingers
sudha03_vpr
Participant
Posts: 34
Joined: Tue Feb 26, 2013 9:36 am
Location: Chicago

@OUTROWNUM can be used in transformer

Post by sudha03_vpr »

@OUTROWNUM can be used in transformer to get the number of records coming out of the link.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: @OUTROWNUM can be used in transformer

Post by ray.wurlod »

sudha03_vpr wrote:@OUTROWNUM can be used in transformer to get the number of records coming out of the link.
... per node
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
prasannakumarkk
Participant
Posts: 117
Joined: Wed Feb 06, 2013 9:24 am
Location: Chennai,TN, India

Post by prasannakumarkk »

"I have to insert the no of rows each DS job Inserts/update/Deletes to the target tables to another table which keeps track of all the DS job info "


If you want to get the number of records processed, the easiest way is to ask the DBMS itself. What is the underlying database. What stage is used to load the records? Try using the pseudocolumns of the database in the after sql to get this counts. There are chances where records pass through the input link of database stages but rejected by the stage. it is not reliable to get the link count.
Thanks,
Prasanna
Post Reply