Search found 45 matches

by jiegao
Thu Nov 03, 2011 6:35 pm
Forum: Site/Forum
Topic: Premium membership activation process
Replies: 1
Views: 3738

Premium membership activation process

I purchased premium membership on Oct 31, but my status is still participant. Sent email to membership director yesterday, no reply. Is anybody taking care of this? How long do I have to wait?
by jiegao
Tue Nov 01, 2011 7:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job performance of huge data volumn
Replies: 7
Views: 2368

That's exactly what I'm suggesting. Whether you double the number of scratch disk spaces or double the number of process nodes, ultimately you need to be able to provision sufficient scratchdisk spac ... Thanks Ray. When I get enough disk space, I will run the job in one shot to see if any performa...
by jiegao
Mon Oct 31, 2011 8:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job performance of huge data volumn
Replies: 7
Views: 2368

You can have multiple scratch disks per node specified in the configuration file. It only makes sense to do that if they're on different file systems. ... Thanks Ray. Yes, even if I use disks supposed to be used for dataset for scratch disk, there is still not enough space to handle all the sorting...
by jiegao
Sun Oct 30, 2011 6:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job performance of huge data volumn
Replies: 7
Views: 2368

Thanks Paul. The sort source is from the result of join stage. I have to resort the the data because the requirement is dfiierent.
Anyway, because the scratch disk space limitation, I have to split the data volume.
by jiegao
Tue Oct 25, 2011 8:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job performance of huge data volumn
Replies: 7
Views: 2368

Job performance of huge data volumn

I have a job with 900 millions of records needed to be sorted before the aggregator stage. It almost fills up 50G of scratch disks (4 nodes, 200G in total). I am wondering if there is any guidance regarding the sort disk size. Should I spilt the data into small volume for processing? Thank you in ad...
by jiegao
Mon Oct 24, 2011 8:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conversion from type "timestamp" to type "dat
Replies: 21
Views: 9952

Try using TO_CHAR(Create_DT, 'YYYY-MM-DD HH24:MI:SS')
by jiegao
Thu Oct 13, 2011 7:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage Query
Replies: 5
Views: 8747

Thanks prakashdasika for your answer. That is exactly what I was curious about.
by jiegao
Wed Oct 12, 2011 9:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage Query
Replies: 5
Views: 8747

Re: difference between CCKCC and CKCC

How do we know if the data are "previously grouped"? "Previously Sorted" is easy to understand. I have a job contains JOIN stage followed by Sort stage. Data are sorted using link sort before the JOIN stage. Can I use "Previously Goruped" option? Why cannot use "Pr...
by jiegao
Fri Sep 17, 2010 7:08 am
Forum: General
Topic: Execute Command Activity parameter
Replies: 3
Views: 2013

ray.wurlod wrote:Pass JobActivityName.$UserStatus as the value of the command's parameter. ...
Thanks for the answer. It works.
by jiegao
Thu Sep 16, 2010 3:05 pm
Forum: General
Topic: Execute Command Activity parameter
Replies: 3
Views: 2013

Execute Command Activity parameter

I need to run a shell script with Execute Command Activity. I would like to pass in the value of other job's UserStatus as the parameter of the shell script. I am not sure how to do it? I would like to avoid wrapping the Execute Command Activity in a seperate sequence job and taking the parameter fr...
by jiegao
Wed Aug 25, 2010 11:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Expose Job sequence as web service
Replies: 2
Views: 2047

write a simple server job that uses DSUtilityRunJob (see the sdk routines) in a transformer. to kick off the Sequence Job....and publish that simple job as a service. Thanks Ernie for your advice. Can you point me to the direction or documnets on how to publish datastage job as a service? Is it a s...
by jiegao
Wed Aug 25, 2010 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Expose Job sequence as web service
Replies: 2
Views: 2047

Expose Job sequence as web service

I need to execute job sequence on demand from a JSP page. I think the best way would be to expose the job sequence as a web service and JSP page will call the web service to execute the data stage job. Please advise the way of doing that. Thanks in advance.
by jiegao
Fri Aug 10, 2007 9:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: rows per transaction setting
Replies: 4
Views: 1723

Stop wanting to have your cake and eat it too. This is not a DataStage thing. If you want all rows to be in one transaction, then that's that - if you can't feed the rows swiftly, then the transactio ... I am going to use 0 for the inserting stage and 1 for the deleting stage to make sure that dele...
by jiegao
Fri Aug 10, 2007 8:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

crouse wrote:Just for grins...

In Director, go to Tools -> Options -> Limits and be 100% sure it is set to "No limit"

-Craig
100% sure it is no limit
by jiegao
Fri Aug 10, 2007 7:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: rows per transaction setting
Replies: 4
Views: 1723

Re: rows per transaction setting

chulett wrote:
jiegao wrote:My question is if link1 and link2 are within the same transaction.
That depends. Two OCI stages? Two transactions. One OCI stage? One transaction. ...
Thanks