Search found 13 matches

by satyam_ps
Thu Jul 09, 2009 2:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap allocation failed
Replies: 2
Views: 2703

to provide additional info All these have been set to unlimited except two initially: time(seconds) unlimited file(blocks) unlimited data(kbytes) unlimited stack(kbytes) 32768 memory(kbytes) unlimited coredump(blocks) unlimited nofiles(descriptors) 2048 but Stack is being set to unlimited in dsenv u...
by satyam_ps
Thu Jul 09, 2009 12:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap allocation failed
Replies: 2
Views: 2703

Heap allocation failed

My job aborts first throwing the below warning message The current soft limit on the data segment (heap) size (1610612736) is less than the hard limit (2147483647), consider increasing the heap size limit and then the below fatal error message: Fatal Error: Throwing exception: APT_BadAlloc: Heap all...
by satyam_ps
Mon Jan 19, 2009 12:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

yes i understand the sort is superfluous... initially i had tried without any sorting..it was not working.then i tried an internal sort... i.e if you open the input for lookup u will have an perform sort option..that is internal sort.

by external sort i meant i am using a seperate sort stage.
by satyam_ps
Mon Jan 19, 2009 12:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

not exactly..... only if i am sorting within the input of the lookup stage(intra stage sort) and then partition it works fine.If i use an external sort and then partition again the same thing happens...it fails.
by satyam_ps
Sun Jan 18, 2009 11:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

yes have checked it..data is exactly same on both sides and one thing which is noteworthy is when i am doing an internal sorting and then hash partitioning in the inputs to the lookup stage for both the links the look up is working perfectly fine since i will be processing huge amount of data i cann...
by satyam_ps
Sun Jan 18, 2009 10:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

Hi All, Tried trimming on both sides for both the columns.... still didnt work....length is same for both !!!! Any idea what wud have possibly gone wrong?
by satyam_ps
Sat Jan 17, 2009 5:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

ok i understand what u guys are trying to say.so for both the links i.e. main and ref i would trim the data.possibly while fetching the data coming from ref link i.e. teradata enterprise stage i will select it with a trim(src_ref) and for the main link i would have to use a transformer to trim the a...
by satyam_ps
Fri Jan 16, 2009 10:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

i will explain in detail what exactly i have done so that it helps u guys analyze the situation.I am partitioning on a single column.The main link data is fed from a data set column name- asset_val(varchar(100)) while the ref link data,column name- src_ref(varchar(100), on which i am looking upon ,i...
by satyam_ps
Fri Jan 16, 2009 11:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning behaving erratically
Replies: 18
Views: 6065

Hash Partitioning behaving erratically

i have a lookup stage where in i am hash partitioning the main and reference link data on a certain key in the input of the lookup stage.to my surprise look up failed since the values inspite being same on main and reference links were in different partitions.introducing a peek stage after modifying...
by satyam_ps
Fri Jan 16, 2009 11:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning in Lookup Stage
Replies: 3
Views: 3218

strange problem encountered in the same context

i have a lookup stage where in i am hash partitioning the main and reference link data on a certain key in the input of the lookup stage.to my surprise look up failed since the values inspite being same on main and reference links were in different partitions.introducing a peek stage after modifying...
by satyam_ps
Thu Jun 19, 2008 11:55 pm
Forum: General
Topic: Job gets aborted due to a phantom error
Replies: 1
Views: 1172

Job gets aborted due to a phantom error

My job gets aborted with teh following error message

Contents of phantom output file =>
RT_SC597/OshExecuter.sh: line 20: 6654 Segmentation fault (core dumped) $APT_ORCHHOME/bin/osh "$@" -f $oshscript >$oshpipe 2>&1

Can anyone help me on this?
by satyam_ps
Wed Jun 11, 2008 11:39 pm
Forum: General
Topic: unix command to export dsx's to a unix folder
Replies: 4
Views: 3421

but it works in windows!!!! I need an unix equivalent
by satyam_ps
Wed Jun 11, 2008 11:19 pm
Forum: General
Topic: unix command to export dsx's to a unix folder
Replies: 4
Views: 3421

unix command to export dsx's to a unix folder

Hi All, Can anyone help me in exporting a number of dsx's from a particular project and server using a unix command.Is there any unix command which when triggered will export a dsx from a particular Datastage project and serevr. There is one whcih works in winfows but the same doesn't work with Unix...