Search found 72 matches

by SettValleyConsulting
Wed Jan 30, 2008 11:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Column Description in Schema File?
Replies: 2
Views: 944

I am going to try and mimic an exported Table Def in dsx format. I've exported a single Table Def and the dsx seems to be straightforward, a standard header then a repeating subgroup for each column plus standard trailer. Description is one of the field properties ==> Simple loop in VBA. Bit of a ha...
by SettValleyConsulting
Wed Jan 30, 2008 10:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Column Description in Schema File?
Replies: 2
Views: 944

Column Description in Schema File?

Is it possible to import the column description from a schema file? I have some Excel spreadsheets containing sequential file descriptions, with column names, data types, lengths and a user friendly column description. It's trivial to write a formula to generate an Orchestrate schema file from the s...
by SettValleyConsulting
Fri Apr 13, 2007 2:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate ID generation in DS EE
Replies: 18
Views: 9069

Are you using Surrogate Key Generator Stage ?
No, we generally use a routine developed in house. I regret I am unable to share that with you.
by SettValleyConsulting
Wed Apr 11, 2007 9:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate ID generation in DS EE
Replies: 18
Views: 9069

Hi Battaliou, Sree I still have access to the code Battaliou is referring to. The problem with the Sparse lookup against a db2 sequence is that the lookup is expecting to do a SELECT WHERE and so requires a key value. If you use the IBMREQD as the key, say IBMREQD = 'Y', this works fine for the firs...
by SettValleyConsulting
Wed Apr 04, 2007 7:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rangelookup
Replies: 8
Views: 3025

Range lookup is coming in Hawk. Until then there are three possible solutions :- 1. Do the range lookup in your RDBMS wherever possible. 2. For a small number of possible values within the range, generate a reference dataset with a row for each value, do an exact match lookup or join, then immediate...
by SettValleyConsulting
Tue Feb 06, 2007 8:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls - to convert or not to convert?
Replies: 6
Views: 2121

... opinions as to if it is possible or advisable to set down a firm rule for nullable columns. I guess the conclusion is no, it is not advisable to lay down a one-size-fits-all-occasions null conversion rule. .. comes from a Harry Potter book That would explain Matt's beard ... he fancies himself ...
by SettValleyConsulting
Tue Feb 06, 2007 8:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls - to convert or not to convert?
Replies: 6
Views: 2121

Thanks, Arnd.

As often happens - you have confirmed my own thinking.

BTW - SettValleyConsulting is actually my old company name, I am more usually known as Phil Clarke, currently sitting three floors above you in Griffin House :lol:

Note to self - must sign posts going forward.
by SettValleyConsulting
Tue Feb 06, 2007 7:47 am
Forum: General
Topic: Takeing backup from command Line.
Replies: 5
Views: 2321

This may be OTT for your needs but here is a VBScript to export a project. You could just extract the parts that do the export into a bacth file. '* '* DSPExport' '* '* '* Script to export a Datastage Project. '* '* Export filename is named after Project + Date '* '* Phil Clarke. June 2005. '* '* '*...
by SettValleyConsulting
Tue Feb 06, 2007 4:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls - to convert or not to convert?
Replies: 6
Views: 2121

Nulls - to convert or not to convert?

I am currently setting out some best practice guidelines for DS EE developers in our department and want to canvas opinions as to if it is possible or advisable to set down a firm rule for nullable columns. We have two schools of thought. One camp maintains that nullable columns cause too many probl...
by SettValleyConsulting
Wed Jul 12, 2006 5:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: cleaning up project
Replies: 13
Views: 5303

Consider periodically clearing down the phantom directory. Phantom is the Datastage term for a subprocess ... eg the process spawned by a routine called by another routine or by a job. The output from these phantoms is written to the phantom directory named &PH& beneath the datastage project...
by SettValleyConsulting
Wed Jul 12, 2006 5:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Its very urgent!!Please reply
Replies: 28
Views: 15771

Is there any function for calculating whether the given date is last day of month? like last_day in sql??? Maybe I am missing something but I don't think Ray's premium solution works, or completely answers the question ... I think Ray's solution returns the last day of month that a given date lies ...
by SettValleyConsulting
Mon Mar 27, 2006 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deleting a dataset
Replies: 15
Views: 16908

Apologies for the duplicate post ... I thought that the first version had disappeared into the bit bucket ...
by SettValleyConsulting
Mon Mar 27, 2006 8:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deleting a dataset
Replies: 15
Views: 16908

This is a fairly common requirement - 'housekeeping' after a run that creates large temporary or intermediate datasets for example. Note that 'orchadmin rm' can accept multiple filenames as arguments. Here is the business part of my script to delete a defined list of datasets, you will need to modif...
by SettValleyConsulting
Mon Mar 27, 2006 8:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deleting a dataset
Replies: 15
Views: 16908

This is a fairly common requirement - 'housekeeping' after a run that creates large datasets for example. Note that 'orchadmin rm' can accept multiple filenames as arguments. Here is the business part of my script to delete a defined list of datasets, you will need to modify the path names for your ...
by SettValleyConsulting
Thu Jan 26, 2006 6:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: View Adapter and Binding
Replies: 2
Views: 1937

I'd suspect RCP as the culprit, magically reinstating SOURCE_CRNC_CODE because it's in the schema somewhere. I thought so too, I suspected RCP was propagating the column despite the explicit DROP, however I switched RCP off in the lookup and the stages immediately upstream and downstream and still ...