Search found 22 matches

by bgs
Thu Jun 11, 2015 6:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file truncating integer
Replies: 1
Views: 1772

Sequential file truncating integer

Hi, I have a parallel job with sequential file as source,and delimeter is ",". Input file has few integer columns. I noticed that if the value received in the integer field is "1 2" sequential file is reading "1" and truncating the rest. Did anyone have this issue and c...
by bgs
Sat May 10, 2014 5:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file issue in parallel job version 8.1
Replies: 3
Views: 1946

ssnegi, Thanks for your reply. As you said this can be achieved using a transformer. But I was trying to understand the reason why it is not rejected. If the value in integer column is "aa" it is rejecting. Even in the decimal column if i give a value "1 0.20" it is changing it t...
by bgs
Fri May 09, 2014 9:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file issue in parallel job version 8.1
Replies: 3
Views: 1946

Sequential file issue in parallel job version 8.1

I have a sequential file stage as a source in my parallel job. I have a reject link to the file to capture the records which don't match the metadata. But for the below data sequential file is not rejecting the record. Ex: Metadata Col1 - date Col2 - integer(3) Col3 - decimal(5,2) Sample data: 2014-...
by bgs
Thu Feb 18, 2010 11:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error loading special chars using oracle enterprise stage
Replies: 3
Views: 1841

Error loading special chars using oracle enterprise stage

I am trying to load special characters (characters of a different language) into oracle table using oracle enterprise stage. target column is varchar . I am able to load the record into table but the characters are changed to something else. Is there any setting I have to change so that oracle enter...
by bgs
Mon May 14, 2007 9:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: mismatch in join stage
Replies: 4
Views: 2222

hi nick,
value in colA is the last character of colB which will have value between 0-9,so all the records with same value should fall in same partition.
I tried repartitioning the data from the dataset and it worked.But I thought using partition type "same" should also work.
by bgs
Sun May 13, 2007 12:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: mismatch in join stage
Replies: 4
Views: 2222

mismatch in join stage

I have two inputs to the join stage. 1. from a dataset which is hash partitioned on col A and sorted on col B. 2. from a transformer. In the join stage I used partitioning type as "same" for the link coming from dataset and for the link from transformer I selected the hash partition on col...
by bgs
Fri Nov 18, 2005 2:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicate Warning
Replies: 3
Views: 1618

when you use different keys for sorting and for removing duplicates you get this warning
by bgs
Tue Jun 14, 2005 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How Dataset differ from Sequential File stage
Replies: 5
Views: 2801

dataset preserves partition.It stores data on the nodes,so when you read from a dataset you dont have to re partition your data.
by bgs
Tue Jun 14, 2005 12:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem with handling nulls with timestamp field
Replies: 4
Views: 1753

in the specification
<columnname> = handle_null(<columnname>,"<replacement value>")
by bgs
Tue Jun 14, 2005 12:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: data segment (heap) size
Replies: 1
Views: 1293

data segment (heap) size

I am getting the following error in one of my jobs.(in join stage) join_records,0:The current soft limit on the data segment (heap) size (2147483645) is less than the hard limit (2147483647), consider increasing the heap size limit in the join stage I am using entire partition in one link(one record...
by bgs
Wed Apr 20, 2005 1:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: AGGR inconsistency running PX 7.5.1
Replies: 3
Views: 1861

the output of the aggregator depends on the partition you are using and the number of nodes.You can try running the agrregator in sequential mode or if you run it in parallel then use hash partition.
by bgs
Tue Mar 15, 2005 5:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple Record Types in sequential files
Replies: 5
Views: 2166

we also had a similar requirement.we read the records as a single column in a sequential file and depending one the record type we extracted the columns in the transformer.
by bgs
Tue Mar 08, 2005 10:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error compiling sequencer
Replies: 2
Views: 1740

Error compiling sequencer

when compiling a sequencer I am getting the following error CJSROUTINE activity not found. And other problem was when I tried to save the sequencer with a different name(using "save as") the sequencer job was converted into a server job.If anyone encountered the same problem please tell me...
by bgs
Sat Feb 26, 2005 10:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: order of execution of Upsert strategy
Replies: 5
Views: 3026

dsxuserrio
I think it will first search if the record is present,and if it finds then it updates else it inserts.
by bgs
Thu Feb 24, 2005 12:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sequential file is rejecting records with null values
Replies: 7
Views: 3714

In the partitions tab in sequential file you can select any collecting type and select the unique option , and select the column in which you receive duplicates.this will sort the incoming records