Search found 34 matches

by collabxchange
Wed Oct 15, 2014 4:51 pm
Forum: General
Topic: Value Expression in Job Activity Stage
Replies: 8
Views: 2284

Thats exactly what I did to make it work. Thanks!
by collabxchange
Wed Oct 15, 2014 3:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key using a state file or Database
Replies: 7
Views: 8299

That is true. I guess it was a requirement coming from a database person who has used DB sequence always but I agree with you. Would you recommend a specific block size of do you recommend the system selected block size? Also, is there a way to tell DS to just maintain it in the XMETA database by de...
by collabxchange
Wed Oct 15, 2014 3:30 pm
Forum: General
Topic: Value Expression in Job Activity Stage
Replies: 8
Views: 2284

True. That threw me off a bit. Its all good now. Thank you very much!
by collabxchange
Wed Oct 15, 2014 2:24 pm
Forum: General
Topic: Value Expression in Job Activity Stage
Replies: 8
Views: 2284

Am I doing something wrong? When I put this expression,

Field(Field(SRC_FILE_NAME,'/',7,1)),'-',1)

it says, "Not enough arguments to function field"
by collabxchange
Wed Oct 15, 2014 2:17 pm
Forum: General
Topic: Value Expression in Job Activity Stage
Replies: 8
Views: 2284

If I use,

Field(SRC_FILE_NAME,'/',6,1)
O/P = folder3

Field(SRC_FILE_NAME,'/',7,1)
O/P = src_Cust-USA-20140101-1.txt

But I want it as "src_Cust-USA" only. Is it possible to use 2 Field() functions in a single expression?
by collabxchange
Wed Oct 15, 2014 1:38 pm
Forum: General
Topic: Value Expression in Job Activity Stage
Replies: 8
Views: 2284

Value Expression in Job Activity Stage

I have a sequencer where I am executing a 'ls' command in the execute command stage. It is picking up the right file but I want to parse it's name into a parameter in the job activity stage. e.g. The file name coming out of 'ls' command is //host/folder1/folder2/folder3/src_Cust-USA-20140101-1.txt I...
by collabxchange
Wed Oct 15, 2014 1:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key using a state file or Database
Replies: 7
Views: 8299

Surrogate Key using a state file or Database

Hi All, I am trying to generate surrogate key or a sequence number for one of my job. As I understand there are 3 ways to do it. Option # 1 : Use Database Sequence if your target is a table. Unfortunately, I can't use this. Option # 2 : Use Surrogate key generator or the surrogate key tab in the sta...
by collabxchange
Fri Oct 10, 2014 2:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

Ernie - Thank you very much. Yes, your understanding on the objective is correct. :) The DS environment has been acting up since morning for which I am not able to develop/test anything at the moment. I will your recommended approach sometime in the weekend or Monday and let you know. Again, thank y...
by collabxchange
Thu Oct 09, 2014 3:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

The problem is I don't know what to match it with against. The External Source outputs only 1 column i.e. File_Name. The data in the File_Name column is actually the file I want to read. It's structure can be Header: Source_system Batch_Id ... Record/Data: R Footer: Count So what I want to do is rea...
by collabxchange
Thu Oct 09, 2014 1:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

Sorry, I should have been little more clear.

The Number of records comes in the form of a field in the footer/trailer called "count" that we want to capture.

Essentially 1st output will capture the file name and a column. 2nd output will capture all records from the XML file.

Thanks
by collabxchange
Thu Oct 09, 2014 10:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

Basically I am trying to do the following, - Look for a patter of XML file in a directory. - Read it and output to 2 different links. Output link 1: It will contain the file name and the count of records(coming in a column from the XML file). Output Link 2: It will fetch the data/records from the XM...
by collabxchange
Thu Oct 09, 2014 8:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

Ernie - Thank you for your response. As you suggested I changed the design to read the input XML file by External Source. But I am not able to figure out how to map it in the XML stage. http://i.imgur.com/mUWL6Wo.png?1 http://i.imgur.com/oWpoeO9.png?1 http://i.imgur.com/20UtWmd.png?1 http://i.imgur....
by collabxchange
Wed Oct 08, 2014 8:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture input XML file name
Replies: 13
Views: 4641

Capture input XML file name

Hi, I have a simple job whose design is XML Stage ---> Column Gen ---> NZ I am reading the input file as a wild card character. E.g. customer*.txt when the actual file name can be customer_206789_USA.txt. Is there an easy way to capture the actual file name as a column in the design so that I can po...
by collabxchange
Wed Oct 01, 2014 9:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help, XML parsing warning
Replies: 1
Views: 3011

Help, XML parsing warning

Hi all, I am using an XML stage and a Column Importer stage to load data into a Netezza table. I am receiving this warning: XML_39,0: 2014-09-30 17:11:41,456 Warn [XML_Parser] [] Start XML Validation Errors (Only first error reported for any path in the schema): Path: [Schema_Node, SOPDataLoad, Reco...
by collabxchange
Tue Sep 23, 2014 3:10 pm
Forum: General
Topic: run a batch script
Replies: 22
Views: 8893

Don't really understand the "job scheduling in Director doesn't work" statement but I'll take it at face value. The inbuilt scheduler in the DS director uses the AT.exe file of Windows OS. Microsoft have removed this file from 2012 Server edition for which IBM Infosphere is not able to us...