Search found 61 matches

by ScottDun
Tue Jan 05, 2016 8:58 am
Forum: General
Topic: Error Message -4 in Sequence Job
Replies: 6
Views: 4654

Error Message -4 in Sequence Job

Hi, I am running my sequence job and I am using a Loop. Within this Loop is a parallel job and then another sequence job. I am returning an error code of "code=-4 [ParamValue/Limitvalue is not appropriate]". I have re-compiled it, added "Ereplace(EC_MAX_ETN.$CommandOutput,@FM,'' )&quo...
by ScottDun
Mon Jan 04, 2016 2:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with reading multiple files
Replies: 8
Views: 4605

I have found the answer to my problem. I put the file name in the parameter of the execute command stage
by ScottDun
Wed Dec 30, 2015 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with reading multiple files
Replies: 8
Views: 4605

another question i have is how can I run multiple files in the command execute stage in a sequence job... I am using "/disk1/data/Projects/EP1978/DEV/input/copy1*.txt" for the parallel jobs. How can I mimic this in sequence?
by ScottDun
Wed Dec 30, 2015 9:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with reading multiple files
Replies: 8
Views: 4605

$APT_MAX_DELIMITER_READ_SIZE (changed default value to 1000000000)
$APT_CONFIG_FILE (changed to a 1 node)

The error messages are too far back to look at, for we ran the job multiple times after we "fixed" it
by ScottDun
Wed Dec 30, 2015 7:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with reading multiple files
Replies: 8
Views: 4605

I changed the job to run on 1 node because I have a smaller amount of data per incoming file. Then I used an environment variable to increase character length for record delimiter to 100000000. This works for now but I need a better way to do it for when there are millions of clients per file. The j...
by ScottDun
Tue Dec 29, 2015 12:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with reading multiple files
Replies: 8
Views: 4605

Problem with reading multiple files

Hi, I created a job where I am using * to input multiple files. I created 6 text files for the input, and each file has 2 providers. For some reason, the output dataset is splitting the output right down the middle. Each file has 44 rows, times 6, is 264. I input a sequence number (1-22) for each pr...
by ScottDun
Mon Dec 28, 2015 12:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to continue to increment a number
Replies: 3
Views: 3570

How to continue to increment a number

I currently created a job that creates a number for every entry into a table. The number will start at 5000 and will increment per provider. So if a file has 10 providers, it will be 5000-5009. If I run this same file again (or if there is a new file) I want it to start at 5010. How do I go about th...
by ScottDun
Wed Dec 23, 2015 8:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Two Links from a Transformer; Missing Information
Replies: 8
Views: 4353

Actually Craig, I figured it out. I inserted a new column "NUM" and then used the Row Number Column and used that in the transformer and it worked.
by ScottDun
Wed Dec 23, 2015 8:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Two Links from a Transformer; Missing Information
Replies: 8
Views: 4353

So an example of the TABLENAME and CLOB columns : HEADER PROVIDER20151223 The HEADER is the first row to populate in the file no matter what. We have a UNIX script that will be reading the file before it enters the job (which I took care of in the sequence job). There are errors that the UNIX looks ...
by ScottDun
Wed Dec 23, 2015 8:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Two Links from a Transformer; Missing Information
Replies: 8
Views: 4353

Company still is a month or so away from securing a membership. That being said, I have the text file that contains "X" amount of rows, 2 columns. The first and last row are simply HEADER and TRAILER and they are the ones that I am focused on in this certain pic. The transformer is separat...
by ScottDun
Tue Dec 22, 2015 8:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Two Links from a Transformer; Missing Information
Replies: 8
Views: 4353

Image

The copy stage will spit out the answer I need just fine. But something may be wrong with the merge itself.
by ScottDun
Tue Dec 22, 2015 8:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Two Links from a Transformer; Missing Information
Replies: 8
Views: 4353

Two Links from a Transformer; Missing Information

Hi, I have a transformer in which I branch off two links. The first link is separating the text file so that the transformer is looking at the header of a file; it gets forwarded to a merge. The second link is looking at the trailer of the file. In the trailer, I need the first 11 characters of the ...
by ScottDun
Mon Dec 21, 2015 3:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting a Derivation to '0001-01-01'
Replies: 5
Views: 2717

I also took out the '%' in front and back of the quotes....

StringToTimestamp(0001-01-01 00:00:00,["%yyyy-%mm-%dd %hh:%nn:%ss"])
by ScottDun
Mon Dec 21, 2015 3:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting a Derivation to '0001-01-01'
Replies: 5
Views: 2717

StringToTimestamp(0001-01-01 00:00:00,[%"%yyyy-%mm-%dd %hh:%nn:%ss"%])

I input this and it isn't working.
by ScottDun
Mon Dec 21, 2015 2:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting a Derivation to '0001-01-01'
Replies: 5
Views: 2717

Setting a Derivation to '0001-01-01'

Hi,

I am trying to default a column, with a Timestamp datatype, to '0001-01-01'. Is there a function that will do that? I typed in the 0001-01-01 and all that was returned were stars because I did not have a function. Any help would be great. Thanks!