Search found 172 matches

by gsherry1
Mon Aug 29, 2005 2:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Automated Data Type Validation
Replies: 1
Views: 858

Automated Data Type Validation

Hello, Is there a method to have DataStage perform data type validiation on incoming data as it is being read in sequential stage. I am looking for something that involves a little less development work than adding an is_valid on every column. In other tools that I have used, I have seen the default...
by gsherry1
Tue Aug 23, 2005 1:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameterization of Aggregation Column Name
Replies: 1
Views: 914

Parameterization of Aggregation Column Name

Is it possible to select the column for aggregation based on Job Parameter? There is no "Insert Job Parameter" option on the input text field, and if I enter a parameter reference, the job compiles but during run it complains that the value does not match any of the input columns.
by gsherry1
Tue Aug 23, 2005 11:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reusable jobs for Fixed record width sources
Replies: 5
Views: 1297

Yes, this is where column propagation works wonders in Px. You could also declere the sequential input with just the initial 3 columns and then click on the "suppress row truncation warnings" and ignore the rest of the input columns. Yes that would work, but it implies that I don't want t...
by gsherry1
Tue Aug 23, 2005 7:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Code Generation - Manipulating Export Files
Replies: 2
Views: 601

Code Generation - Manipulating Export Files

I was wondering if people have any experience on manipulating column information and parameters in the dsx and xml export files in order to achieve some flexiblity that cannot be gained in through the GUI interface. My understanding is that after altering the export file, you would then have to impo...
by gsherry1
Tue Aug 23, 2005 7:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reusable jobs for Fixed record width sources
Replies: 5
Views: 1297

Reusable jobs for Fixed record width sources

I have many files that are all fixed format. They differ in record length but the first 3 columns are the same. I wish to create a job that manipulates only the first few fields and can run on all of my data sources. However, I seem unable to do this in Server edition as I don't know how to setup th...
by gsherry1
Tue Aug 23, 2005 6:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reuseable Jobs with EBCDIC data
Replies: 2
Views: 2329

Thanks vmcburney. Problem with the CFF stage is it does not seem to support schema files, and thus makes it difficult to parameterize processing involving sources with variations in column formats. The orchestrate shell guide 4.5 seems to suggest that describing EBCDIC sources is possible with a sch...
by gsherry1
Mon Aug 22, 2005 9:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Escaping Delimiters & Newlines
Replies: 2
Views: 1005

Escaping Delimiters & Newlines

Is it possible to escape data values that are equal to the delimiter used or the newline character used, to prevent the file from being parsed incorrectly?
by gsherry1
Mon Aug 22, 2005 8:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reuseable Jobs with EBCDIC data
Replies: 2
Views: 2329

Reuseable Jobs with EBCDIC data

Suppose I wish to create a job that will take input filename for an EBCDIC source as parameter and convert this to ASCII format. I wish to call this job with many different source formats. In each case I wish the input file to transform the datatypes to most appropriate non-mainframe datatype. For e...
by gsherry1
Thu Aug 18, 2005 7:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Obtaining Column Information within Transform.
Replies: 3
Views: 1024

Obtaining Column Information within Transform.

I am interested in knowing what methods are avialable for accessing the column name and other column information within transform deriviations. Suppose I wished to perform lookup on source whose key is the column names on my input data. My first step would be to create a new column and try to popula...
by gsherry1
Tue Aug 16, 2005 12:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trash Stage
Replies: 11
Views: 2790

Trash Stage

In Server, is there a method of ending a flow of logic without writing to a file? Ie. Something equivalent to Ab Initio Trash component? I have situation where I was running a stage for side effect purposes and don't really want to write any output.
by gsherry1
Wed Aug 10, 2005 11:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject thresholds for reject links
Replies: 6
Views: 4772

Reject thresholds for reject links

Is there any functionality for setting abort thresholds on reject links. For example, if more than 50 records on reject link then abort job. Or even better, if > 1% of records end up on reject port, then abort job. I understand that I can always join to the non reject link and do some calculation th...
by gsherry1
Wed Aug 10, 2005 11:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapper problem
Replies: 3
Views: 1314

Re: Wrapper problem

I receive a very similar error when trying to edit a wrapped stage. Whenever I click on "generate" I never get any feedback. After making the edits and attempting to use, it complains that the operator is not found.
by gsherry1
Tue Aug 02, 2005 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapped Unix Stage Problem
Replies: 5
Views: 2560

ray.wurlod wrote:And what happens then? Does that fix the problem, or are you explaining that that's how you implement the Wrapped stage in your design?
No, it did not fix my problem. I was merely clarifying how I implemented the wrapped stage.
by gsherry1
Fri Jul 22, 2005 7:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapped Unix Stage Problem
Replies: 5
Views: 2560

Eric wrote:Have you re-generated the wrapped stage?

After making the edits in Manager I click on generate and then ok.
Then I go to my job, delete the original wrapped stage, refresh my repository, and drag the edited wrapped stage onto the job.
by gsherry1
Thu Jul 21, 2005 11:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapped Unix Stage Problem
Replies: 5
Views: 2560

Wrapped Unix Stage Problem

I have been having some problems working with wrapped stages. At first the wrapped stage I create works. However after making any edits to the wrapped stage via Manager, and adding the edited stage to my job, I receive the following error: No operator found for stage type ' mylist '. mylist is actua...