Search found 33 matches

by go4it
Tue May 22, 2012 10:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validation in the datastage server job.
Replies: 4
Views: 3594

You can spilt the file to get Header and trail records, when passing the trailer records use Aggregort Stage to get the COUNT on number of rows and compare with value in the Header. Input File - Header Row - Check count Trailer Agg -> Count(number of records) Hope this helps
by go4it
Tue May 22, 2012 9:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: 421 Timeout (900 seconds): closing connection. 7.5.1A AIX
Replies: 6
Views: 4878

What is your environment like ?

Can you try a simple FTP script (Unix Script) and schedule it via Cron to mitigate issue on the networking side.

Just my thoughts
by go4it
Thu Feb 04, 2010 5:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML generation
Replies: 1
Views: 1391

XML generation

I have created the XML chunks (about 5) and when I tried to embed the XML chunks (nested loops) into the Main XML document either using a Look up or Join stage I get the following error: Fatal Error: Virtual data set.; output of "APT_JoinSubOperatorNC in Join_256": the record is too big to...
by go4it
Thu Dec 17, 2009 9:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datasets issue
Replies: 4
Views: 3043

Chulett,

It is creating *.ds file.

I have tried to remove the files and rerun the job, still I am getting the issue.

Please advice.

Regards
C
by go4it
Thu Dec 17, 2009 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datasets issue
Replies: 4
Views: 3043

Datasets issue

Hi, I have a set of jobs that extracts data and write to a dataset, teh design is as follow <sourceStage> ------> Copy Stage -----> Dataset Stage The jobs works fine, but when I tried to run the job again after a couple of weeks later (i.e. today), The job finishes OK with lots of warnings, I checke...
by go4it
Tue Nov 10, 2009 8:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warinings from a Routine
Replies: 2
Views: 1755

Warinings from a Routine

I am calling a Data Stage Server Routine in a Sequencer which then calls a EE job, The Server Routine is used to unpack some data in the Source file, most of the times the Routine works fine but at times when unpacking it might hit issues that were not captured, so the Sequencer Aborts after 50 rows...
by go4it
Thu Oct 29, 2009 10:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issues when calling a Routine in Seq
Replies: 6
Views: 3438

when I call the Seq1 from Master Seq ?
by go4it
Thu Oct 29, 2009 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issues when calling a Routine in Seq
Replies: 6
Views: 3438

Chulett,

The only error message that I get is below

<Sequencer name>.JobControl (fatal error from @Count_Abort): Sequence abort requested

The Routine does a count check and returns 0 if true or else returns 1 for false condition.

Please advice
by go4it
Thu Oct 29, 2009 7:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance of datasets
Replies: 4
Views: 2112

Hi Ray/Craig, I tried teh following and it worked, when running I changed the Config file and it worked fine, but when the next job to load the dataset in oracle was called it was taking a while and aborting after a while. On discussions with the DBA, found that there was not enough space and the nu...
by go4it
Thu Oct 29, 2009 6:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issues when calling a Routine in Seq
Replies: 6
Views: 3438

Issues when calling a Routine in Seq

Hi All, I have sequencer1 that calls 3 jobs and a routine, the jobs design sequencer 1 comprises of teh below: Job1 -> routine -> Job2 -> Job3 The sequercer1 is called by a Master Sequencer, Sequencer1 runs fine as a stand alone but when I try to call it it within the Master Sequencer the first job ...
by go4it
Wed Oct 28, 2009 12:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance of datasets
Replies: 4
Views: 2112

Thanks ray, but the problem here is when I to write to another datasets.

Dataset1 -> xfm -> Dataset2

Takes more time and aborts.
by go4it
Wed Oct 28, 2009 10:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance of datasets
Replies: 4
Views: 2112

Performance of datasets

Hi, I have around 15 million records extracted and written to a dataset 1 and transformed the dataset 1 to dataset 2 ( not much changes, mostly one to one mapping), however the issue I have is it takes a while to write to the dataset 2 and takes much longer time to load the data from dataset 2 into ...
by go4it
Fri Aug 14, 2009 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuration file
Replies: 1
Views: 1705

Configuration file

IS v8.1 has been installed on Windows having a Core duo Processor with 4 GB of RAM When I am try to create a 2 nodes configuration file, I get the following warning message: <main_program> Warning: Config file checker on node node1 can only create 3 processes. IBM recommends that ORCHESTRATE users b...
by go4it
Wed Aug 05, 2009 4:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Difference in calculation for decimal (38,10) fields.
Replies: 13
Views: 9372

There are environment variables for handling decimal data: APT_DECIMAL_INTERM_ROUND_MODE, descrption is it specifies the default rounding mode for any decimal intermediate variables required in calculations. The default is round_inf. APT_DECIMAL_INTERM_SCALE Specifies the default scale value for any...
by go4it
Wed Aug 05, 2009 2:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: convert Binary data to ascii format
Replies: 10
Views: 10186

The main issue is we DONOT have any Cobol Copy Books, We have been given a spreadsheet with the fields with start positions and number of bytes, also there are lots of Arrays, redfinitions and Occour Depening on clauses that are not upto the Cobol Standards. Also we have one single field that holds ...