Search found 112 matches

by chetan.c
Mon Jul 09, 2012 7:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Startup time high in jobs having a DB operation
Replies: 11
Views: 5457

chulett wrote:..Cross that one off your list. :wink:
:) Few more things which I can check and cross them off ..?

Thanks,
Chetan.C
by chetan.c
Mon Jul 09, 2012 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Startup time high in jobs having a DB operation
Replies: 11
Views: 5457

Hi Craig, Actually we are just testing the job runs in this environment,so its not with actual live data. The data that is maintained in the tables of both the environment is almost the same(Checked record counts).Infact in the new environment its lesser than the dev environment. I understand its di...
by chetan.c
Mon Jul 09, 2012 12:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Startup time high in jobs having a DB operation
Replies: 11
Views: 5457

Hi Paul and Kryt0n , Sorry I dint mention the DB. Its Oracle. Look up Configuration. Enable_partioned reads---Yes Patitioned Read method--Rowid Hash Record Count ---20000 Array size ---2000 Prefetch count---1 No before or after SQl statements. Insert Configuration: Write mode---Insert Table Action -...
by chetan.c
Fri Jul 06, 2012 9:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Startup time high in jobs having a DB operation
Replies: 11
Views: 5457

Startup time high in jobs having a DB operation

Hi, Startup time of parallel jobs that contain Database lookups and/or inserts is high. Like 40 seconds for startup and production time is 5 seconds. I read the posts here,and came across &PH& directory cleanup.There were around 1600 files which we cleared. This did not result in any change ...
by chetan.c
Wed Jun 20, 2012 2:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to get last value in each row
Replies: 7
Views: 3821

Hi,

In the output derivation:

Code: Select all

field(DSLink2.val,"_", @INROWNUM)
Transformer has to run in sequential mode.


Thanks,
Chetan.C
by chetan.c
Wed Jun 06, 2012 3:58 am
Forum: General
Topic: Roadmap to learn datastage
Replies: 6
Views: 7098

Late on replying to the thread, but wanted to share my views. In the video below Ray says its important to learn with a mentor,which i believe is most important aspect of learning to work with the tool. http://www.youtube.com/watch?v=wx8UuCYSxXc I have been struggling for that,but thanks to dsxchang...
by chetan.c
Wed Jun 06, 2012 2:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: usage of pxpivot stage for vertical pivot
Replies: 5
Views: 3163

Re: usage of pxpivot stage for vertical pivot

fyaqq wrote:I found our current datastage installation there is a enterprise pivot (pxpivot) stage for parallel job!
Hi,

Add the stage to the canvas and click on Help .
It will lead you to the information you are asking for.

Thanks,
Chetan.C
by chetan.c
Sat Jun 02, 2012 9:13 am
Forum: General
Topic: Run Multiple Instance Parallelly
Replies: 6
Views: 2643

There's no reason to force them to the background ... Hi Craig, Actually i tried without forking the process ( with & removed) the execution of sequences happened sequentially. But I want to run these instances parallely.So I went for this. Thats where the wait problem is occuring. Thanks, Chet...
by chetan.c
Sat Jun 02, 2012 7:37 am
Forum: General
Topic: Run Multiple Instance Parallelly
Replies: 6
Views: 2643

True.
But when I was testing it ,whats happening is ,the jobs get triggered and the script ends immediately after that wihtout waiting for the job status to return.

So trying to figure out to make the script wait untill all the jobs have completed and then only end the script.


Thanks,
Chetan.C
by chetan.c
Sat Jun 02, 2012 4:54 am
Forum: General
Topic: Run Multiple Instance Parallelly
Replies: 6
Views: 2643

Run Multiple Instance Parallelly

Hi, Im trying to run a multiple instance job from a script. The job instances should run parallely . So to test it I developed a simple sequence job(Multiple Instance) with Only job activity stage .Its underlying parallel job(Also multiple Instance) reads from a sequential file and writes it to anot...
by chetan.c
Thu May 31, 2012 3:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: logic
Replies: 9
Views: 4475

Had posted an incorrect thought...Deleting it.
by chetan.c
Tue May 29, 2012 2:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Seeking a best solution in DataStage
Replies: 28
Views: 29122

Hi, StageVaribale: svconcat svconcat:Inputlink.desc Output derivation Map all columns to output except number as per your requirement but in place of desc column use the stage variable svconcat . Constraint: LastRowInGroup(Inputlink.id) Sort incoming data as it is a necessary for LastRowInGroup() el...
by chetan.c
Tue May 29, 2012 12:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error with Oracle connector stage
Replies: 3
Views: 24348

Re: Error with Oracle connector stage

Hi,

In the connector there is option under properties. "Drop Unmatched fields" select this to yes.

Thanks,
Chetan.C
by chetan.c
Fri May 25, 2012 7:15 am
Forum: General
Topic: Shell script takes longer execution time in DS than prompt
Replies: 8
Views: 3778

Not enough information for anyone to do anything other than guess. What does the script do? Hi Craig, The script is below. #!/bin/bash zipped_file=Smaple.gz Directory=$1 Archive=$1 Log_File_Path=$3 dir=`date +%Y%m%d` cd $Directory gzip *.xml ls -1 *.gz>File_Names.txt file="$Directory/File_Name...
by chetan.c
Fri May 25, 2012 7:13 am
Forum: General
Topic: Shell script takes longer execution time in DS than prompt
Replies: 8
Views: 3778

Startup time of the job, probably. Enable player timings and display of startup to confirm. ... I'm not seeing startup time of the sequence job.In parallel jobs i can see it. Will it be displayed in sequence job after Enabling Player timings. Also what I did was to echo timestamp just before the co...