Getting linkcount from previous stage
Moderators: chulett, rschirm, roy
Getting linkcount from previous stage
I have a job where data is going from a join stage to a transformer. The link between the join stage and the transformer stage is called Link1. In the transformer, in a stage variable, I need the count of rows coming into Link1 for a calculation. I don't want to use DSGetJobInfo for every row which will slow the system down enormously. How do I get around this problem?
What kind of 'count'? A running count can be had using the @INROWNUM system variable. The total count that is going to be coming? I'm afraid you won't know that until you've gotten them all.
If what you need is the latter, that typically involves two-pass processing or at least some kind of pre-processing so you know how many records you are going to be dealing with. Perhaps someone out there knows the best way to go about something like that in a PX job...
If what you need is the latter, that typically involves two-pass processing or at least some kind of pre-processing so you know how many records you are going to be dealing with. Perhaps someone out there knows the best way to go about something like that in a PX job...
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Final Count
Hello ABC123, how did you end up obtaining the final count in a seperate job? Thanks!!!