Search found 57 matches

by deepa.y
Fri Feb 17, 2012 3:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to convert columns to rows
Replies: 29
Views: 12250

To use vertical pivot,before vertical pivot stage,in transformer i took a column called pivot assigned it to 1 and then used two pivot stages to pivot col1 seperately taking group by column as pivot and col2 seperately .Finally,using funnel stage, merged them to single file.
by deepa.y
Fri Feb 17, 2012 2:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to convert columns to rows
Replies: 29
Views: 12250

Hi Kandy,
I searched here and i found that it can be done by vertical pivot.So,i implemented the same thing using Vertical pivot.But it works only if the number of records are known.
Please suggest me how to implement this in transformer stage by taking count of records.
by deepa.y
Fri Feb 17, 2012 1:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to convert columns to rows
Replies: 29
Views: 12250

Need to convert columns to rows

Hi, I have the data under 2 columns col1 col2 a 1 b xy c 3 And the number of records under two columns differ from file to file. I need to convert column data to records i.e the output should be a,b,c 1,xy,3 . I tried this using vertical pivot but it is working only if there are fixed number if reco...
by deepa.y
Fri Feb 17, 2012 12:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Untar the tar files
Replies: 13
Views: 5188

Hi,
As we have huge files,we cannot store it on disk.The issue is resolved.We are using External source stage to read the tar file to standard output and using them further .
tar -xOvf path of file.
by deepa.y
Wed Feb 15, 2012 7:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Xpath issue
Replies: 3
Views: 1802

Hi Ernie, In the xml which i have given,under the tag <ns2:messageheader> , there is declaration for namespace ns2 as xmlns:ns2="http://csi.cingular.com/CSI/Namespaces/Types/Public/ MessageHeader.xsd . Under the tag <SOAP-ENV:Body> , the namespace prefix ns2 is again used and declaration is ns2...
by deepa.y
Tue Feb 14, 2012 11:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Xpath issue
Replies: 3
Views: 1802

XML Xpath issue

Hi, I have the following xml file. <?xml version="1.0" encoding="utf-8"?> <SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"> <SOAP-ENV:Header> <ns2:MessageHeader xmlns="http://csi.cingular.com/CSI/Namespaces/Types/Public/CingularDataMode...
by deepa.y
Tue Feb 14, 2012 1:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Issue
Replies: 2
Views: 1595

Thanks Kandy
by deepa.y
Tue Feb 14, 2012 12:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Issue
Replies: 2
Views: 1595

Performance Issue

Hi,
We have a requirement in the project to replace particular string with null.So,we decided to use PX version of Ereplace() function.
But it is said that if we compile C++ routine at server side,it affects performance.

Could you please let me know whether it affects performance?
by deepa.y
Mon Feb 13, 2012 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to read two xml files using parallel job
Replies: 6
Views: 3879

I haven't tried it, but "in theory" I suspect it will work, using the xmlInput Stage....of course, the details of namespaces and elements/attributes will have to be fully populated on each of the outp ... In the first XML,the column version has the xpath as /Request/soap:Envelope/soap:Hea...
by deepa.y
Mon Feb 13, 2012 5:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to read two xml files using parallel job
Replies: 6
Views: 3879

Re: Need to read two xml files using parallel job

I will be getting many files from source and could not say the exact elements of those files. even though the xml files contain the same elements,their namespace prefixes are different. I am pasting 2 sample xml files. XML1: <Request> <soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/e...
by deepa.y
Mon Feb 13, 2012 1:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to read two xml files using parallel job
Replies: 6
Views: 3879

Need to read two xml files using parallel job

Hi, I created a parallel job to parse the xml.The job has the following stages. External_source stage--->XML_input stage--->Sequential file stage. I can parse the xml successfully using the above job. But ,from source i am getting xml files with different elements in it. Is that possible to parse th...
by deepa.y
Thu Feb 09, 2012 3:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Insert a character in a string at particular positio
Replies: 5
Views: 2530

Thanks Ray
Thanks Pandeesh
That worked fine.
I am resolving this topic
by deepa.y
Thu Feb 09, 2012 2:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Insert a character in a string at particular positio
Replies: 5
Views: 2530

The length of input string will vary but position of characters to be inserted will be at 4th and 8th only.
by deepa.y
Thu Feb 09, 2012 2:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Insert a character in a string at particular positio
Replies: 5
Views: 2530

Need to Insert a character in a string at particular positio

Hi,
I have an input string "AAABCCDEK".I want to insert a character '^' at 4th and 8th position of the string using transformer stage.
My output should look like this "AAA^BCC^DEK".
Can somebody help me out in this logic?
by deepa.y
Wed Feb 08, 2012 7:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Untar the tar files
Replies: 13
Views: 5188

Hi Ray,
Each tar file contains multiple folders and each folder inturn contain few files.Filter command is not working in this case as it cannot be read like file.