Data Lineage in Job
Moderators: chulett, rschirm, roy
Data Lineage in Job
When I try to view data lineage in a DataStage parallel job, the lineage appears to stop at a stage variable that is used for some mapping activitiy. Is this how it works, or is there something I need to do differently? Thanks so much for your help.
-
- Premium Member
- Posts: 138
- Joined: Wed Jul 16, 2008 9:51 pm
- Location: Kolkata
Data Lineage in Job through Transform Stage
I have a job with multiple steps, one of which is a Transform stage. In the Transform stage, I am using a Stage Variable to format a column, then mapping the Stage Variable to the output column.
When I go to the target stage, right click and select to trace where a column came from, the lineage diagrammed on the job canvas shows a link back to the Transform stage where the stage variable comes from, but does not continue the lineage back to the source stage.
With a little more looking, it looks like the lineage is only tracing back to the Transform stage even when I use a straight mapping from input to output without a Stage Variable involved.
Have you had a problem seeing the lineage in this situation?
When I go to the target stage, right click and select to trace where a column came from, the lineage diagrammed on the job canvas shows a link back to the Transform stage where the stage variable comes from, but does not continue the lineage back to the source stage.
With a little more looking, it looks like the lineage is only tracing back to the Transform stage even when I use a straight mapping from input to output without a Stage Variable involved.
Have you had a problem seeing the lineage in this situation?
You are doing it correctly. The only time that lineage should stop at the column level is if the output column is derived from a Stage variable that doesn't use any input link cols.......if it does, then lineage should continue thru the Stage. There is apparently dual patch for this..one for DataStage and one for the Metadata Workbench. The workbench one is part of a patch for 8.1.2 and was released on June 14th and is available at the central patch site.....I'm not sure of the DataStage one at the moment, but will post a note if I find out.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I didn't find it at fix central, but maybe I missed it..... maybe it has to be requested specifically....anyway, I've been told that it's number if JR33537, if that helps. Let support qualify the requirement for you --- it's possible that the fix does other things also, or maybe it's rolled up somewhere....
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>