Search found 34 matches
- Wed Oct 15, 2014 4:51 pm
- Forum: General
- Topic: Value Expression in Job Activity Stage
- Replies: 8
- Views: 2284
- Wed Oct 15, 2014 3:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Surrogate Key using a state file or Database
- Replies: 7
- Views: 8299
That is true. I guess it was a requirement coming from a database person who has used DB sequence always but I agree with you. Would you recommend a specific block size of do you recommend the system selected block size? Also, is there a way to tell DS to just maintain it in the XMETA database by de...
- Wed Oct 15, 2014 3:30 pm
- Forum: General
- Topic: Value Expression in Job Activity Stage
- Replies: 8
- Views: 2284
- Wed Oct 15, 2014 2:24 pm
- Forum: General
- Topic: Value Expression in Job Activity Stage
- Replies: 8
- Views: 2284
- Wed Oct 15, 2014 2:17 pm
- Forum: General
- Topic: Value Expression in Job Activity Stage
- Replies: 8
- Views: 2284
- Wed Oct 15, 2014 1:38 pm
- Forum: General
- Topic: Value Expression in Job Activity Stage
- Replies: 8
- Views: 2284
Value Expression in Job Activity Stage
I have a sequencer where I am executing a 'ls' command in the execute command stage. It is picking up the right file but I want to parse it's name into a parameter in the job activity stage. e.g. The file name coming out of 'ls' command is //host/folder1/folder2/folder3/src_Cust-USA-20140101-1.txt I...
- Wed Oct 15, 2014 1:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Surrogate Key using a state file or Database
- Replies: 7
- Views: 8299
Surrogate Key using a state file or Database
Hi All, I am trying to generate surrogate key or a sequence number for one of my job. As I understand there are 3 ways to do it. Option # 1 : Use Database Sequence if your target is a table. Unfortunately, I can't use this. Option # 2 : Use Surrogate key generator or the surrogate key tab in the sta...
- Fri Oct 10, 2014 2:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
Ernie - Thank you very much. Yes, your understanding on the objective is correct. :) The DS environment has been acting up since morning for which I am not able to develop/test anything at the moment. I will your recommended approach sometime in the weekend or Monday and let you know. Again, thank y...
- Thu Oct 09, 2014 3:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
The problem is I don't know what to match it with against. The External Source outputs only 1 column i.e. File_Name. The data in the File_Name column is actually the file I want to read. It's structure can be Header: Source_system Batch_Id ... Record/Data: R Footer: Count So what I want to do is rea...
- Thu Oct 09, 2014 1:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
- Thu Oct 09, 2014 10:21 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
Basically I am trying to do the following, - Look for a patter of XML file in a directory. - Read it and output to 2 different links. Output link 1: It will contain the file name and the count of records(coming in a column from the XML file). Output Link 2: It will fetch the data/records from the XM...
- Thu Oct 09, 2014 8:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
Ernie - Thank you for your response. As you suggested I changed the design to read the input XML file by External Source. But I am not able to figure out how to map it in the XML stage. http://i.imgur.com/mUWL6Wo.png?1 http://i.imgur.com/oWpoeO9.png?1 http://i.imgur.com/20UtWmd.png?1 http://i.imgur....
- Wed Oct 08, 2014 8:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture input XML file name
- Replies: 13
- Views: 4641
Capture input XML file name
Hi, I have a simple job whose design is XML Stage ---> Column Gen ---> NZ I am reading the input file as a wild card character. E.g. customer*.txt when the actual file name can be customer_206789_USA.txt. Is there an easy way to capture the actual file name as a column in the design so that I can po...
- Wed Oct 01, 2014 9:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Help, XML parsing warning
- Replies: 1
- Views: 3011
Help, XML parsing warning
Hi all, I am using an XML stage and a Column Importer stage to load data into a Netezza table. I am receiving this warning: XML_39,0: 2014-09-30 17:11:41,456 Warn [XML_Parser] [] Start XML Validation Errors (Only first error reported for any path in the schema): Path: [Schema_Node, SOPDataLoad, Reco...
- Tue Sep 23, 2014 3:10 pm
- Forum: General
- Topic: run a batch script
- Replies: 22
- Views: 8893