Search found 288 matches

by dspxlearn
Mon May 05, 2008 7:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Suppress "Status Code=0" output of dsjob command
Replies: 13
Views: 11794

i don't want to capture the status codes and it doesn't have -jobstatus option in it.
my code was

Code: Select all

dsjob -stageinfo DS_PROJECT DS_JOB$INVOCATION_ID DS_STAGE
I tried to redirect it to device null (>/dev/null) but it isn't working..
by dspxlearn
Mon May 05, 2008 7:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Suppress "Status Code=0" output of dsjob command
Replies: 13
Views: 11794

Hi, I am sorry to reopen this old issue. Actually, i was trying to suppress this return code (Status code = 0) from my dsjob commands. I got this issue posted few months back and i tried this option posted by ray.wurlod. But, couldn't succeed in eliminating this return code. dsjob ... | grep -v 'Sta...
by dspxlearn
Thu Apr 24, 2008 6:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Total Records processed
Replies: 5
Views: 1953

Thanks AmeyJoshi14-

I never said i didn't like to use shell :) . Infact, i am writing the similar script as you posted. I fact, shell scripts are more convenient for these kind of requirements rather than using DSroutines.

Thanks for your time.
by dspxlearn
Wed Apr 23, 2008 6:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Total Records processed
Replies: 5
Views: 1953

Thanks Kumar- Right. As you said, i have to use names something like 'SRC_RECS' for input links, 'TGT_RECS' for output links and 'REJ_RECS' for reject link. In this way, after using these naming conventing across jobs, i need to just use the link names to capture the record count at these 3 differen...
by dspxlearn
Wed Apr 23, 2008 2:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Total Records processed
Replies: 5
Views: 1953

Total Records processed

We have a requirement in which we have to capture the total number of records pulled from the source, total number of records loaded and number of records rejected. We can do this using the "dsjob -lstages" from the scripts by using the linknames and stage names and putting it in a loop to...
by dspxlearn
Tue Apr 15, 2008 4:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting the very first event of the job log
Replies: 3
Views: 1315

Getting the very first event of the job log

Hi, I am trying to get the first event id from the log whenever the job starts. Using this event id i want to capture all the parameter values used in the job. Using this is could get only the last event id. DSGetLogEntry(JobHandle, DSGetNewestLogId(JobHandle, DSJ.LOGANY)) Can anyone suggest me how ...
by dspxlearn
Sun Apr 06, 2008 11:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Enterprise stage - Load and Upsert
Replies: 10
Views: 6336

Thanks vnspn, As of now i am using the Upsert method to load. We have two joins stages and aggregation functions(on these 1.5 million records) and filters before loading the data into the target database. For all this process it is taking 1hr and 45 mins. I am waiting for my DBA's permission to get ...
by dspxlearn
Fri Apr 04, 2008 1:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Enterprise stage - Load and Upsert
Replies: 10
Views: 6336

vnspn- What is the total number of records inserted. Per your earlier post, i understand that you will be processing about 5 million in 5 different loads. And can you please let me know what is the total processing time taken for all these inserts? Cause, i am doing a performance tuning with all dif...
by dspxlearn
Thu Apr 03, 2008 1:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using Hint on a partitioned table
Replies: 3
Views: 1805

Thanks Craig. I will have to speak to our DBA and post his comments here. Just wanted to know for inserts into a partitioned table what would be the better possible Hint we can make use of? From most of the few earlier posts, i see that many use /*+APPEND*/ hint. But, we have onlyinserts going every...
by dspxlearn
Thu Apr 03, 2008 7:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using Hint on a partitioned table
Replies: 3
Views: 1805

Using Hint on a partitioned table

Hi, We are loading about 15-16 mill records in a Oracle table which is partitioned. As of now,we could have all the inserts/joins in less than 2 hrs. So, to increase the records inserts much faster, i am thinking of using a PARALLEL Hint during insert into the table. But, i read somewhere that /*+PA...
by dspxlearn
Tue Apr 01, 2008 6:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Only inserts through Oracle Enterprise stage
Replies: 18
Views: 7559

As posted earlier, what would be the result if we use the below options? Upsert: write method Upsert mode: User defined update only Update SQL: Writing just an INSERT SQL statement instead on UPDATE statements. I tried it and its working. But not sure how it impacts performance compared to the other...
by dspxlearn
Sun Mar 30, 2008 10:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Only inserts through Oracle Enterprise stage
Replies: 18
Views: 7559

How about these options:

Code: Select all

Write method : Upsert
Upsert mode: User defined update only
Update SQL: Write just an INSERT SQL statement instead on UPDATE statements
Can you post what was your approach?
by dspxlearn
Thu Mar 13, 2008 10:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Notification activity - blank file as attachment
Replies: 6
Views: 2058

ArndW,

Can you please post the page which explains how to avoid these kind of attachments here please... :)
by dspxlearn
Thu Mar 13, 2008 9:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Notification activity - blank file as attachment
Replies: 6
Views: 2058

Notification activity - blank file as attachment

Hi, I was using Notification activity in job sequencer to e-mail a group with a CSV file attachment and some subject in the e-mail. Every thing was working fine. But, i am getting an additional blank text file with 242Bytes attached to the e-mail. It is named as ATT8321619.txt. I did a search on the...
by dspxlearn
Thu Feb 28, 2008 3:39 pm
Forum: General
Topic: database
Replies: 6
Views: 2644

I guess most likely it would be DB2; as it is also an IBM product. :)