Search found 504 matches

by ShaneMuir
Wed Feb 11, 2015 8:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicates - Retain both Duplicates
Replies: 6
Views: 1667

Just as a question, what is the data source in this process? If its a DB there might be ways of avoiding a split fork join by incorporating the identification of potential duplicates into your select query.
by ShaneMuir
Wed Feb 11, 2015 8:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Insert New Rows Only using ODBC Connector to MSSQL
Replies: 10
Views: 11293

Insert New Rows Only using ODBC Connector to MSSQL

Hi All I am having a little bit of an issue when executing a process to update a target MSSQL DB using an ODBC connector stage with the Write mode set to Insert New Rows Only. The issue is, that it works for some target tables and not others. We have checked for differences in the table set up betwe...
by ShaneMuir
Fri Oct 17, 2014 10:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Implicit Data Type conversions
Replies: 3
Views: 3639

Thanks for the input Mike I was thinking about an explicit cast during selection, via a view. I was trying to avoid that as there would be 200+ tables for which I would have to write views, then there is the on going maintenance if they ever change the table structures (which they do constantly). I ...
by ShaneMuir
Fri Oct 17, 2014 8:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Implicit Data Type conversions
Replies: 3
Views: 3639

Implicit Data Type conversions

Hi All I am facing an issue with implicit data type conversions and I am hoping that somebody can help. My job is a relatively simple one: ODBC(ora) ----> copy -----> ODBC(ora) The job is fully parameterised and RCP is enabled. The job itself has no columns specified. The job is to read data from on...
by ShaneMuir
Wed Mar 13, 2013 11:04 am
Forum: General
Topic: Reading Envrironment Variable in Local Variable
Replies: 4
Views: 1838

You could just add them to the parameter list and pass them as a parameter?

Or you could try GetEnvironment("NM_USER") - but not sure if that works in a sequence.
by ShaneMuir
Wed Mar 13, 2013 4:44 am
Forum: General
Topic: Sequence job aborting
Replies: 8
Views: 2947

Does the routine only select the one value? Is it possible to pass out the value that is being passed to the log? Can you put an execute command stage in and just echo the parameter value as it passed to the job? Does any part of the sequence past the running of the routine run correctly? Is it alwa...
by ShaneMuir
Wed Mar 13, 2013 3:58 am
Forum: General
Topic: Sequence job aborting
Replies: 8
Views: 2947

What value are you passing the parameter P_BATCHID and what data type is the parameter?
by ShaneMuir
Wed Mar 13, 2013 2:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: logic required for horizontal pivot
Replies: 13
Views: 5533

Have you already split the input columns into separate columns is it still a single column containing the comma delimited record? To do the looping: 1. Set up your 3 output columns: Name, Description, Phone 2. Set up 2 loop variables eg lvDescription, lvPhoneNum; Set the loop while to @ITERATION <=3...
by ShaneMuir
Tue Mar 12, 2013 6:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split one column into multiple columns
Replies: 7
Views: 6526

Re: Split one column into multiple columns

Use a nested select statement where you add a row number:

select * from
(select key, row_number() over(partition by 1) as rownum from table1)
where rownum > 1;
by ShaneMuir
Tue Mar 12, 2013 6:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8447

If you set up your schema that way, then yes it will split it into 2 separate columns. But how do you determine what data is in which column? You will need the column headers to determine which input columns goes to which output column. Actually if you have column headers you can create a single job...
by ShaneMuir
Tue Mar 12, 2013 4:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8447

Sorry I wasn't clear on that.

For each input file that you receive, will it have column headers?
by ShaneMuir
Tue Mar 12, 2013 3:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8447

Do you have static column headers provided with the file?
by ShaneMuir
Tue Mar 12, 2013 3:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8447

From soure i have 4 columns and runtime i need to pick 1 key column and any 2 of those 3 columns. file is comma separated only,Please suggest me how to do this. When you say Any 2 of those 3 columns, are you suggesting that the input file could have a mix of columns? eg Row 1 of the file could be K...
by ShaneMuir
Tue Mar 12, 2013 3:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Assign value for more then one record
Replies: 3
Views: 2749

Hmm. 2 ways spring to mind. Option 1 1. Sort by Column 2, then by column 1. Add a keyChange columns 2. In a transformer, on the input link re-sort by column 2, keychange asc. 3. In a stage variable (sv1), hold the value of column 2 where keychange = 0 4. In another stage variable have the logic: If ...
by ShaneMuir
Tue Mar 12, 2013 3:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split one column into multiple columns
Replies: 7
Views: 6526

So the source is a DB? If that is the case - are you able to ensure that the first row selected is the header row? If you can you can just as easily exclude it in your select statement.