Search found 19 matches

by nkumar_home
Thu Dec 09, 2004 11:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Extender usage
Replies: 9
Views: 4816

PX is real fast but depends on how many processors you have set your PX config file to use. It tends to take over a majority of the CPU utilization for those processors. If you are using PX with just 4 processors then you should design your batch so that relatively very few jobs run during the PX jo...
by nkumar_home
Wed Nov 03, 2004 2:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORACLE9i issue
Replies: 19
Views: 8816

an case to do it outside of datastage as a sql script spooling to a file.

That way you can put a parallel hint
/*+ full(table_name) parallel(table_name, 8) */
and force it to go in parallel and the dump to file is not slowed down by the server throughput, or if you have PX do it in PX.
by nkumar_home
Wed Nov 03, 2004 2:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: please Help in routine
Replies: 2
Views: 1881

Re: please Help in routine

You could try this- If you need to send an e-mail for every row that f1 is > f2 then you can use the below logic within the datastage job f3 = f1:',':f2 DSSendMail("From:x@abc.com\nTo:y@abc.com\nSubject:Hi\nBody:f3\n") Or you can write all records with f1 > f2 to a file and call DSSenMail ...
by nkumar_home
Tue Nov 02, 2004 3:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: unable to use job after abort
Replies: 6
Views: 4585

Have you tried to 'Cleanup Resources' from Director for the job. Normally that clears out all the processes. If the lock on the job is still not released then you can try the Clear Status from Director. This should return the job to compiled status. If above does not work make sure no phatom process...
by nkumar_home
Tue Nov 02, 2004 11:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SIGSEGV error in a PX job that has been running normally
Replies: 3
Views: 2821

SIGSEGV error in a PX job that has been running normally

The PX job reads from a partitioned Oracle table and then copies the data set using the copy stage after which there is a lookup stage followed by a aggregator stage and finally the oracle upsert stages. The job has run fine until Oct 31st when it aborted with the " Operator terminated abnormal...
by nkumar_home
Mon Nov 01, 2004 4:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Empty File check in Server Job Sequence
Replies: 3
Views: 4758

Is your filename to check - Users.csv - a job parameter? The Execute Command stage doesn't parse them correctly. Yes, the log entry looks just peachy but the actual command executed includes the untranslated job parameter, which may be what's tripping you up. Me, I'd do this in a routine and use DS...
by nkumar_home
Mon Nov 01, 2004 4:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Empty File check in Server Job Sequence
Replies: 3
Views: 4758

Empty File check in Server Job Sequence

I am using the test -s filename command in the ExecuteCommand stage to check for a an empty file. A return code of 0 continues control to the next job else the sequence aborts. However this does not work. Always aborts with following message whether the file is empty or not. "JobSeqLoadAdExtrac...
by nkumar_home
Wed Sep 15, 2004 2:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Finding all jobs that are using 'Create Table' option in OCI
Replies: 4
Views: 2302

FYI...
I think I have found a round about way of doing this. I am exporting the jobs in the project in XML format and writing a job to parse it to look for a property value of 'Yes' for the 'CREATETABLE' node.
by nkumar_home
Wed Sep 15, 2004 10:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Finding all jobs that are using 'Create Table' option in OCI
Replies: 4
Views: 2302

Finding all jobs that are using 'Create Table' option in OCI

I have a routine to search jobs for a string but it does not work for this case since the 'Create Table' is an option in datastage and searching for string 'create table' does not return anything. Is there any specific string I need to look for to identify jobs using this option. In the logfiles on ...
by nkumar_home
Wed Sep 01, 2004 2:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job definitions errors
Replies: 1
Views: 1185

Job definitions errors

Hi I was moving a few jobs via version control. Midwat through I got disconnected to the server. Connected back and found I could open one of the jobs. Tried to delete the job but got an error that could not open RT_BP333 and RT_BP333.O. Also when I tried to import a bunch of jobs again hit some err...
by nkumar_home
Thu Aug 19, 2004 4:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequence Job - retrieving Logs
Replies: 24
Views: 12127

Here is some unix code you could use or modify. *********************************** dsjob -logsum Proj Jobseq > TEMPFIL1 for AbortJob2 in `cat TEMPFIL1 | egrep "\(Aborted\)|\(Finished with warnings\)" | cut -f 4 -d " "` do dsjob -logsum Proj Jobseq > TEMPFIL3 done ***************...
by nkumar_home
Thu Apr 29, 2004 2:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sum of three columns is short by 1 cent, data is truncated
Replies: 5
Views: 3009

We have had many such issues in our jobs but mostly involving multiplication or division where the decimal precision changes. So we use the round function within Oracle so that we can have a predictable result rather than an arbitrary drop of precision.
by nkumar_home
Thu Apr 29, 2004 2:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX job reading fewer rows from a table than present.
Replies: 0
Views: 2047

PX job reading fewer rows from a table than present.

Only change was the source table was moved from Dictionary managed tablespaces to locally managed tablespaces. Details. PX 6.1., HP-UX, Oracle 8.1.7 We have a PX job "LoadETLDMSalePX" that writes to a table ETL_DM_SALE with the "Append" option. The other options are "Index M...
by nkumar_home
Fri Apr 23, 2004 1:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Keeping the old value on update
Replies: 4
Views: 2274

Copy the sql generated by the "Insert new or update Existing rows" option. Then change to "User defined sql". Paste the sql from above but make the changes to the update part to use the columns from the table instead of the host variables. This same mechanism can be used even if ...
by nkumar_home
Thu Apr 22, 2004 3:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle err when using PX and no error when using Server job
Replies: 2
Views: 3798

What are the options you have selected for Source and Connection.

Have you selected "Partition Table"? If so PX needs to be able to read some of the sys tables to get partition information.