Search found 34 matches

by collabxchange
Thu Feb 05, 2015 2:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Netezza Stage Logging
Replies: 1
Views: 1426

You can write a small delete script in bash or something and schedule it to run via linux scheduler.
by collabxchange
Thu Feb 05, 2015 2:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

I read the contents in the link and made some progress but its just not working and I am not sure where it is going wrong. To summarize, The XSD structure is below SO_PRODUCT (Parent P1) ---->SO_PRODUCT_ATTRIBUTE (child C1) ---->PRODUCT_ASSOCIATION (child C2) --------->PRODUCT_ASSOCIATION_ATTRIBUTE ...
by collabxchange
Wed Feb 04, 2015 12:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

Actually 4 output links as "Product_Association" has another one nested called "Product_Association_Attribute" as shown in the picture. Now I have 4 output links containing the respective elements from each blue "list" icons. I apply the transformation, etc using the tr...
by collabxchange
Wed Feb 04, 2015 12:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

Not just more but way too much to learn. :) So, I imported the XSD into the library manager and here is how it looks like. http://i.imgur.com/AuHg3rR.png I have highlighted the the blue "list" icons in yellow. In the assembly editor, I have 3 steps. Input Step; XML Parser Step; Output Step...
by collabxchange
Wed Feb 04, 2015 9:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

Hello Ernie, Thank you very much for the details. The XML file in question is of 1 GB size. Hence, I am using the HierarchicalData Stage (formerly XML Stage). I have already imported the XSD as XML Table Definition like Ray suggested. Now what should I use in the assembly palette to read the data? A...
by collabxchange
Tue Feb 03, 2015 3:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

Yes, I used the above data to generate the XSD which looks like below <?xml version="1.0"?> <xs:schema id="import_data" xmlns="" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata"> <xs:element name="i...
by collabxchange
Tue Feb 03, 2015 3:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML File Transformations
Replies: 10
Views: 6196

XML File Transformations

Hi, Being not very familiar with XML files, I am struggling a bit to achieve the following objective. It will be very helpful if someone can please direct me to right approach or design. Objective : Read a XML file, apply some transformations to its data (e.g. switch cases, change some values, etc) ...
by collabxchange
Thu Dec 18, 2014 10:00 am
Forum: General
Topic: Get record count as a User Variable
Replies: 7
Views: 3645

Originally, I wanted to do an actual count of Table_A on the database, but I'm limited on time. This routine can check if any records were inserted into Table_A daily. It's no where near perfect, but will get the job done.
by collabxchange
Fri Dec 05, 2014 12:05 pm
Forum: General
Topic: DS User credential on Windows
Replies: 3
Views: 2272

I added the VM A as an administrator on VM B and it worked!

Thanks.
by collabxchange
Fri Dec 05, 2014 10:17 am
Forum: General
Topic: DS User credential on Windows
Replies: 3
Views: 2272

DS User credential on Windows

When we run a DS job on Windows via DS Scheduler, what user ID does it use? Is it the user ID by which it was compiled last?

Say my DS job, is running on a Windows VM A and want to write a file to another VM B or to a shared drive, how do I make sure that it has appropriate permission to do so?
by collabxchange
Mon Nov 17, 2014 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Round to nearest tenth
Replies: 3
Views: 2679

Round to nearest tenth

Hi,
I searched the forum but couldn't get any answer. Does anyone know how to round a number to nearest equal to higher tenth.

e.g.

12 --> 20
15 --> 20
1.4 --> 10

Thanks!
by collabxchange
Sat Oct 18, 2014 2:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture Record Insert Date and Record Update Date in SCD Sta
Replies: 2
Views: 2001

I could but how can it help me identify those records which were updated with type 1?
by collabxchange
Sat Oct 18, 2014 1:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture Record Insert Date and Record Update Date in SCD Sta
Replies: 2
Views: 2001

Capture Record Insert Date and Record Update Date in SCD Sta

Hi, I am trying to load a Dimension table which has a mixture of Type 1 and Type 2 columns in it. The data population is working fine as expected when I use the SCD stage. But I am wondering if there is a way to populate Record_Insert_Date and Record_Update_Date in this table based on if a record is...
by collabxchange
Thu Oct 16, 2014 1:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Netezza userdefined update query issue
Replies: 6
Views: 15753

akshyat wrote:[[twt]] signifies the temporary work table. During run time the netezza connector stage automatically assigns values for these two tables.
If TWT is assigned at runtime then how would you give its exact name in the sql?
by collabxchange
Wed Oct 15, 2014 7:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key using a state file or Database
Replies: 7
Views: 8286

Thank you, Ray. I will use the state file in the jobs are see how it goes. BTW, what is your opinion about using the inbuilt DB sequence? The only options are DB2 and Oracle. Since we have DB2 for XMETA repository, I can ask for a separate database in it for generating sequence. Will it provide any ...