Search found 21 matches

by r_arora
Wed Apr 16, 2008 1:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read XML Issue
Replies: 3
Views: 2001

My design is : External Source Stage --> Read XML Stage --> Transformer --> Sequential File
by r_arora
Wed Apr 16, 2008 1:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read XML Issue
Replies: 3
Views: 2001

Read XML Issue

I am reading the ETL Job Statistics from an XML File and loading a sequential file. But when I run my job I am getting the following error: main_program: Could not locate operator definition, wrapper, or Unix command for ", quote=none} ( AuditJobID:int32 {quote=none}; Name:string[max=255]; Desc...
by r_arora
Mon Apr 07, 2008 10:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Max Value from each partition
Replies: 2
Views: 1606

Max Value from each partition

Hello, I have a scenario where I want the maximum date from each partition.And from the set of rows I get, I have to get the maximum of that date and write it to a dataset. For example, If I have 4 partitions I will get 4 max dates, then I will sort these set of 4 dates and get the maximum out of th...
by r_arora
Wed Mar 19, 2008 10:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

I included a "Partition Table" option in my oracle stage and gave my source table name as the partition table name, and I can see the performance statistics now. Both the issues have nothing in common and they are independent yet including this option enabled the performance statistics. :o
by r_arora
Fri Mar 14, 2008 8:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

This is happening only when I introduce an ODBC stage in my job. If I work with sequential files, I am able to see the job statistics.I have to generate a xml file (DSJobReport) for every job and will need the no. of rows processed through each link. Right now I am getting 0 rows processed for each ...
by r_arora
Wed Mar 12, 2008 3:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

I have checked the "Show Performance Statistics" in the job diagram but still can't see the job statistics.
by r_arora
Wed Mar 12, 2008 2:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

After I executed sh jobmoninit command I tried running one of my simple jobs which just reads from a sequential file and writes to another sequential file, the job showed me the statistics. But when I used an Oracle stage, I did'nt see the statistics again. If i read from a sequential file or any ot...
by r_arora
Wed Mar 12, 2008 12:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicates -Rejected Records
Replies: 6
Views: 3483

here is a suggestion: Use a sort stage..sort on EmpNo and make the clusterKeyChange value "True". Then put a constraint on your transformer where all records having clusterKeyChangeValue 1 should go in one dataset and the other to the other dataset. You will get 2 datasets..one with all un...
by r_arora
Wed Mar 12, 2008 11:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Throws error
Replies: 15
Views: 7051

just to clarify 20 lakh is 2 million records
by r_arora
Wed Mar 12, 2008 10:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Throws error
Replies: 15
Views: 7051

I am doing an inner join between two oracle tables having around 20 lakh records. Actually one of the sources have about 90 million records but I have used a User Defined SQL there which returns about 20 lakh records passed to the join stage.
by r_arora
Wed Mar 12, 2008 10:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Throws error
Replies: 15
Views: 7051

I changed the values of APT_MONITOR_SIZE and APT_MONITOR_TIME but still getting a broken pipe error. It's strange that when I replace the join stage with a lookup stage my job runs successfully and loads the data to the sequential file.
Any help regarding this issue will be greatly appreciated.
by r_arora
Wed Mar 12, 2008 9:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

APT_NO_JOBMON is set to false and APT_RECORD_COUNTS is also set to True. I have explicitly included these variables in my job and set their values. Still I am unable to see the record counts in my job. It only shows 0 rows.
by r_arora
Wed Mar 12, 2008 8:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

I don't see any port 13400 or 13401 when I issue the netstat -an command :(
by r_arora
Tue Mar 11, 2008 4:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capturing Source and Target Table Names
Replies: 1
Views: 1064

Capturing Source and Target Table Names

Hello, I have a requirement to capture the names of the source and target tables/files used in the parallel job. For Example: If I have 3 sources A,B and C, I need to assign A|B|C (concatination of Source Table Names A,B and C) and store it in a parameter and later assign this value of the parameter...
by r_arora
Tue Mar 11, 2008 3:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the Job Monitor
Replies: 20
Views: 8198

Problem with the Job Monitor

I have a parallel job which runs successfully..imports required no. of records (as shown in the job log) into the sequential file. But in the designer, it does not show any job statistics. Even though my job ran successfully I cant see the no. of rows passing through each stage. Job monitor also doe...