Search found 155 matches

by devsonali
Fri Mar 15, 2013 8:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data manipulation logic
Replies: 18
Views: 7626

Data manipulation logic

Hello everybody. I am trying to work on the logic for manipulating data and here is the scenario Input data row no flag YEAR Code m_Cost_a m_Value_a n_cost_a n_Value_a 1 M 2000 1 10 20 '' '' 2 N 2000 2 '' '' 13 14 3 M 2000 3 15 16 '' '' 4 M 2001 3 19 20 '' '' 5 M 2001 4 23 40 '' '' and so on an so f...
by devsonali
Thu Jan 10, 2013 1:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

I think aggregator can only be used when we have standard values for example if we are expecting all 1 s and 0 s as data values for these columns then i think its pretty straight forward (as you and others have mentioned ) but the if we get values like 'abc' , 'def' so on and so forth then I am gues...
by devsonali
Thu Jan 10, 2013 7:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

James , That is correct but I am curious if we have to do looping within the transformer to achieve this (that was my initial concern ) but from your response it looks like just to check key change would take care of that . Its pretty confusing to me and I will go ahead and test as you mentioned bel...
by devsonali
Wed Jan 09, 2013 10:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

Point noted . Though the intention of asking was never to offend.
by devsonali
Wed Jan 09, 2013 9:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

Any suggestions/inputs from the members ?
by devsonali
Wed Jan 09, 2013 8:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

James I went through the documentation and tested a few jobs with last row in the group . However I am still stuck at the part where you say "For the first record you encounter in a key group, copy the column values into stage variables. For subsequent records, copy only the 1s into stage varia...
by devsonali
Wed Jan 09, 2013 4:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

jwiles you mentioned that "In 8.5 or later, use LastRowInGroup() to output the desired row for each key group" I think i didn't quite get it so if I have say 4 rows with same value for Name and different column values e .g Name col1 col 2 a 1 0 a 0 1 b 1 0 b 0 1 If I take last row in the g...
by devsonali
Wed Jan 09, 2013 1:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping data
Replies: 17
Views: 8621

Grouping data

Hello All I am pretty sure somebody might have asked this before, but really not sure what phrase to use to search this situation I have data with 2 columns say Col 1 and Col 2 and rows record 1, record2 etc I have input file in the format Rows col1 col2 record 1 1 0 record 2 0 1 record 1 0 1 record...
by devsonali
Tue Oct 16, 2012 8:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Connector Import Converts Date into Timestamp
Replies: 3
Views: 2018

Oracle Connector Import Converts Date into Timestamp

Hello All I am trying to import metadata via Oracle Connector import by connecting to Oracle DB . One of the column in Oracle shows the datatype as Date 10 (as it should be ) but once I import the metadata , the same field shows up as timestamp (no length defined ) I was wondering why this would hap...
by devsonali
Thu Oct 04, 2012 3:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DFLOAT DATATYPE MISMATCH
Replies: 2
Views: 4022

I retried to just load the data as it is by choosing the Float datatype as such It gave me Schema reconciliation detected a size mismatch for column noofauditors. When reading database column DFLOAT into column SFLOAT, truncation, loss of precision or data corruption can occur. (CC_DBSchemaRules::re...
by devsonali
Thu Oct 04, 2012 3:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DFLOAT DATATYPE MISMATCH
Replies: 2
Views: 4022

DFLOAT DATATYPE MISMATCH

Hello All , I have an issue where I am trying to pull a decimal fields which loads as Float (when I import the metadata definition from the database ), however when i just try process the data to say peak stage for testing purposes I have the following error Schema reconciliation detected a size mis...
by devsonali
Mon Sep 17, 2012 3:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sql Server Unique Identifier
Replies: 5
Views: 3889

Yup , I we would need one (I am new to sql server too ) but what about metadata , Should this pk be the part of metadata ? (If Yes then since there is no value for this new column coming in it wouldn't compile ?)
or should it be like insert into table T1 ( pk1,a,b ) VALUES (newid(),'value1','Value2')
by devsonali
Mon Sep 17, 2012 11:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sql Server Unique Identifier
Replies: 5
Views: 3889

Missed to add this information :

When I use insert option instead of user defined SQL

It fails with " Cannot insert the value NULL into column . "
by devsonali
Mon Sep 17, 2012 10:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sql Server Unique Identifier
Replies: 5
Views: 3889

Sql Server Unique Identifier

Hello Gurus Here is the problem I need to insert Columns A and B from say table T1 to Table T2 . Table T2 has primary key defined as column PK1(GUID) . Now lets say I have one row corresponding to Column A and B from T1 that I need to insert into T2 . When I do the usual insert into Table T2 (Sql Se...
by devsonali
Fri Apr 20, 2012 1:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Funnel stage loosing columns
Replies: 3
Views: 3987

Funnel stage loosing columns

Hello All, I am seeing an issue in my job , I am trying to funnel a set of columns (making sure that metadata matches ) into a funnel stage,all the column show up in input tab but the output tab (that shoes the mapping ) misses a few columns . I tried to delete the funnel stage and add a new funnel ...