Search found 46 matches

by NigeGriff
Mon Sep 08, 2008 7:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removing header and trailer records from Complex Flat Files
Replies: 3
Views: 1850

I have run the following command via the filter option to select only certain record types - 'grep '^.\{0\}1' filename' . Datastage returns the following error message in the director log - ##E TOIX 000001 15:27:46(000) <AKF841Source,0> Failure during execution of operator logic. ##F TUXX 000001 15:...
by NigeGriff
Mon Sep 08, 2008 7:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removing header and trailer records from Complex Flat Files
Replies: 3
Views: 1850

Removing header and trailer records from Complex Flat Files

The selection tab on the server CFF stage allows for just detail records to be selected, using the record type. However there does not seem to be the same functionality on the Px CFF Stage. I have been trying to make use of the Filter box on the FileOptions tab, applying a unix command to select the...
by NigeGriff
Mon Sep 08, 2008 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ignoring header and trailer records
Replies: 5
Views: 1846

I would still like an answer as to why the use of the filter feature does not work.
by NigeGriff
Fri Sep 05, 2008 3:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ignoring header and trailer records
Replies: 5
Views: 1846

I am trying to do something similar. The selection tab on the server CFF stage allows for just detail records to be selected, using the record type. However there does not seem to be the same functionality on the Px CFF Stage. I have been trying to make use of the Filter box on the FileOptions tab, ...
by NigeGriff
Fri Apr 18, 2008 7:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: FTP Enterprise Stage
Replies: 1
Views: 767

FTP Enterprise Stage

Hi, does anyone know if the FTP stage can handle secure FTP or SFTP for short? There are limitations around security that will stop us from using this stage if it is not using the secure ftp process.

Thanks,
Nigel
by NigeGriff
Wed Nov 15, 2006 9:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Tuning
Replies: 9
Views: 4821

Oracle OCI

You should not try to process large volumes through the Oracle OCI (if this is the stage you are using) in datastage. You need to think about Bulk Loader or the Oracle Merge statement in a Stored Procedure.

Cheers,
Nige
by NigeGriff
Tue Jun 06, 2006 4:52 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Jobs and Sequences
Replies: 3
Views: 1133

Re: Jobs and Sequences

[quote="NigeGriff"]Hi, is there an quick and easy way to find out what Jobs or Sequences are called by another Job Sequence? A DS_.... table that contains parent/child relationships would be nice. We use Datastage 7.5.1 Server Edition on Unix AIX. thanks, Nigel[/quote] The answers no then ...
by NigeGriff
Mon Jun 05, 2006 10:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Jobs and Sequences
Replies: 3
Views: 1133

Jobs and Sequences

Hi, is there an quick and easy way to find out what Jobs or Sequences are called by another Job Sequence? A DS_.... table that contains parent/child relationships would be nice.
We use Datastage 7.5.1 Server Edition on Unix AIX.

thanks,
Nigel
by NigeGriff
Thu Jan 19, 2006 6:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and Writing to the same hash file
Replies: 2
Views: 1408

Reading and Writing to the same hash file

We are using Datastage 7.5.1 on Unix AIX. We have a job that reads and writes to the same hash file. The job will lookup the hash file and if a certain criteria is met will then update that row setting an indicator. If the indicator is set then that hash file row should not then be used for future r...
by NigeGriff
Wed Oct 12, 2005 4:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Excel functions for Normsdist and Normsinv
Replies: 1
Views: 702

Excel functions for Normsdist and Normsinv

Hi, we are running Datastage 7.5.1 Server Edition on Unix and have a requirement that we need to replicate a couple of Excel functions, namely Normsdist and Normsinv. Has anyone had to do anything like this?

Any help would greatly apprecitated.

Thanks,
nigel
by NigeGriff
Mon Sep 05, 2005 2:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using ODBC stage accessing SQL Server Text field
Replies: 8
Views: 2826

Hi, instead of using the odbc stage we have used the DRS (dynamic relational stage) which has the needed long character support within, this is a new stage in 7.5. We also had to play about with the column metadata of the longvarchar field, because allowing it to default to 2gb for each column and t...
by NigeGriff
Tue Mar 08, 2005 4:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using ODBC stage accessing SQL Server Text field
Replies: 8
Views: 2826

I have tried using substring and when using 8k (max length for substring)chunks the data runs through ok. The xml text is 68748 bytes long, and I have substring'd all of it and it comes through ok. The field is defined as longvarchar with a length of 2147483647. Is there a limit on the maximum field...
by NigeGriff
Mon Mar 07, 2005 10:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using ODBC stage accessing SQL Server Text field
Replies: 8
Views: 2826

That was a quick reply. Thanks for that. I have just run through without the xml field and it runs ok. Then when stepping through using debug, I get down to the 18th record, then crash. The xml data for the 18th and other records around it look ok, but I can't check all, there are 1000's of bytes in...
by NigeGriff
Mon Mar 07, 2005 9:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using ODBC stage accessing SQL Server Text field
Replies: 8
Views: 2826

Using ODBC stage accessing SQL Server Text field

Hi, I am currently trying to read a SQL Server table that contains XML in a field defined as text. The job is able to process some of the rows of data, but when reaching a certain row the job abends with 'Abnormal termination of stage ... detected'. I have imported the column metadata from the SQL S...
by NigeGriff
Thu Sep 02, 2004 3:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and writing arrays to and from sequential files
Replies: 5
Views: 1940

Processing Arrays

Thanks for the response. I have tried the CFF stage and it wants to flatten out the occurs (which it did incorrectly, but that's another matter). The problem I have is that the arrays are not a fixed number of occurances, and the processing I need to do, is at Customer level using the various array ...