Search found 27 matches

by richieRich
Wed Oct 30, 2013 11:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use @OUTROWNUM as sequential file name suffix
Replies: 9
Views: 4263

Hi All, I'm still having some issues trying to get the XML output stage to work without the sequential file stage. Here are some settings that I have tried... Document Settings > Comments > Generate XML Header - unchecked >Header > Include > unchecked > Namespace Declaration - Include checked with 2...
by richieRich
Tue Oct 29, 2013 4:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use @OUTROWNUM as sequential file name suffix
Replies: 9
Views: 4263

Thanks. Chulett I very much like your idea. I've spent some time removing the sequential file stage that was an output to my xml output stage from my job and setting up the xml output stage to have an output file name etc. Now when I run my job with the xml output stage as the last stage in my flow ...
by richieRich
Tue Oct 29, 2013 4:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Output stage in Parallel Job - bad performance
Replies: 6
Views: 2396

Hi, Yes what Ernie is saying sounds very like what was suggested happens. A wrapper for a parallel job. However from the sounds of all the responses I don't think it is a concern hence I'll go back to my parallel written job and continue with that. Thanks all for the answers. I'm going to mark this ...
by richieRich
Mon Oct 28, 2013 3:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use @OUTROWNUM as sequential file name suffix
Replies: 9
Views: 4263

Thanks Ray.

That's a shame for me. So if my parallel job writes multiple files I can't seem to think of a way I could get it to write multiple files without overwriting the original.

Because there is no way to add a unique identifier?
by richieRich
Sun Oct 27, 2013 11:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use @OUTROWNUM as sequential file name suffix
Replies: 9
Views: 4263

Use @OUTROWNUM as sequential file name suffix

Hi, I got stuck this afternoon trying to use @OUTROWNUM as the suffix for my sequential file name. I have a transformer(TF_HEAD) that links to an xml output file(XML_HEAD) stage that links to a sequential file stage (SF_HEAD). In TF_HEAD I have a column named FILE SUFFIX which is equal to @OUTROWNUM...
by richieRich
Sun Oct 27, 2013 10:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Output stage in Parallel Job - bad performance
Replies: 6
Views: 2396

woops sorry. Rather than saying a sequence job is loaded in per instance of the XML stage I meant to say "server job". I don't think this changes the answer though.
by richieRich
Sun Oct 27, 2013 3:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Output stage in Parallel Job - bad performance
Replies: 6
Views: 2396

XML Output stage in Parallel Job - bad performance

Hi, We are on DataStage version 8.0. I've just got through the pain of writing a nice little job that reads from a database and then creates an XML document using multiple XML output stages. I've now been told by someone on my team that it is not best practice to use the XML Output stage in a parall...
by richieRich
Thu Oct 24, 2013 6:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple rows from different sources into single row
Replies: 5
Views: 2771

Thank you so much for your advice. This worked for me.
by richieRich
Thu Oct 24, 2013 3:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple rows from different sources into single row
Replies: 5
Views: 2771

So to summarize it better I guess what I'm trying to do is convert multiple rows with non repeating columns into a single row with multiple columns. Not just a single row with 1 column.
by richieRich
Thu Oct 24, 2013 2:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple rows from different sources into single row
Replies: 5
Views: 2771

But the trick with my scenario is that all three transformers lead back to the same oracle enterprise stage. So the rows coming out of the transformers come out one by one. I.e. I want to read all the rows then after all rows are read combine output as originally described. For a join to work you ne...
by richieRich
Thu Oct 24, 2013 3:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple rows from different sources into single row
Replies: 5
Views: 2771

Multiple rows from different sources into single row

Hi all, I am just a data stage beginner. I've been searching on the forums on whether it's possible to merge multiple rows from different sources into one row. So far the pivot stage seems to be the closet thing to what I want but I'm still not sure it will meet my requirements. Let me explain. I ha...
by richieRich
Thu Sep 23, 2010 5:11 am
Forum: General
Topic: Problem Using Sed via Routine Activity
Replies: 5
Views: 3272

Yep Thanks guys.... Command=sed -e Parameters= "s/\&apos;/\'/g;s/\</\</g;s/\>/\>/g;s/DATE_YYYYMMDD/#DATE#/g" MyFile.txt > /tmp/out.txt && rm MyFile.txt && mv /tmp/out.txt MyFile.txt It was just confusing seeing the Command as Sed -e. I wasn't sure whether that Execute C...
by richieRich
Wed Sep 22, 2010 6:43 pm
Forum: General
Topic: Problem Using Sed via Routine Activity
Replies: 5
Views: 3272

Thanks Ray. That way the hint I needed. I've got it to work now. The only thing I'm confused about is how to run a command straight after my sed. In my routine activity I could do a sed, redirect the output to /tmp then do a && and then write another command to overwrite my original file wit...
by richieRich
Wed Sep 22, 2010 12:49 am
Forum: General
Topic: Problem Using Sed via Routine Activity
Replies: 5
Views: 3272

Problem Using Sed via Routine Activity

Hi All, I am having a strange problem whilst trying to use Sed via a Routine Activity Stage in my sequence job. I am doing a global replace of multiple patterns. Sed is working to replace text but as soon as I start to try and replace numbers it is getting totally confused. I assume this is somethin...
by richieRich
Sun Jul 25, 2010 10:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with the PX version of EReplace
Replies: 4
Views: 2157

Thanks for your responses. Sorry Ray I just did a reply on the original thread where the function code was listed. Ah yes there is XML at play here. In order to get a comma separated list from the oracle database I have used .. select rtrim( xmlagg(xmlelement(c,columnvalue1 ||'~'||columnvalue2||'^')...