Hi,
How can i do below in datastage 8.5
Thanks,
When extracting table information from SAP into Dataset, we should know how many records (rows) have been extracted from the SAP table and how many records have been writen to the Dataset table. Likewise, when the information is processed into the Staging tables and into the Datamart Tables. It is to be noted that in some cases, it will be impossible to confirm the row count between 2 stages (SAP-Dataset, Dataset-Staging, or Staging-Datamart) when there is ETL transformation occurring or when the original source tables are split into multiple target tables
row counts
Moderators: chulett, rschirm, roy
There are DataStage Server routines to let you get the number of rows passing through specific links, they require a bit of programming. You could also use scripts to search through the job log and parse out the appropriate values, that might be simpler.
Which method you use depends upon what you want to do with the numbers.
Which method you use depends upon what you want to do with the numbers.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
If you were to upgrade to version 8.7 you would get the new Operations Console which comes with a repository for storing ETL metadata such as row counts for all links in a job. This is an open repository and you could run reports and audits against it such as row counts. It's possible in the link naming conventions to indicate which links are supposed to have reduced rows and which are the primary input and output of a job just by using different prefixes in the link names.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: