Search found 46 matches
- Mon Sep 08, 2008 7:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing header and trailer records from Complex Flat Files
- Replies: 3
- Views: 1850
I have run the following command via the filter option to select only certain record types - 'grep '^.\{0\}1' filename' . Datastage returns the following error message in the director log - ##E TOIX 000001 15:27:46(000) <AKF841Source,0> Failure during execution of operator logic. ##F TUXX 000001 15:...
- Mon Sep 08, 2008 7:35 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing header and trailer records from Complex Flat Files
- Replies: 3
- Views: 1850
Removing header and trailer records from Complex Flat Files
The selection tab on the server CFF stage allows for just detail records to be selected, using the record type. However there does not seem to be the same functionality on the Px CFF Stage. I have been trying to make use of the Filter box on the FileOptions tab, applying a unix command to select the...
- Mon Sep 08, 2008 7:24 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ignoring header and trailer records
- Replies: 5
- Views: 1846
- Fri Sep 05, 2008 3:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ignoring header and trailer records
- Replies: 5
- Views: 1846
I am trying to do something similar. The selection tab on the server CFF stage allows for just detail records to be selected, using the record type. However there does not seem to be the same functionality on the Px CFF Stage. I have been trying to make use of the Filter box on the FileOptions tab, ...
- Fri Apr 18, 2008 7:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: FTP Enterprise Stage
- Replies: 1
- Views: 767
FTP Enterprise Stage
Hi, does anyone know if the FTP stage can handle secure FTP or SFTP for short? There are limitations around security that will stop us from using this stage if it is not using the secure ftp process.
Thanks,
Nigel
Thanks,
Nigel
- Wed Nov 15, 2006 9:33 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Tuning
- Replies: 9
- Views: 4821
Oracle OCI
You should not try to process large volumes through the Oracle OCI (if this is the stage you are using) in datastage. You need to think about Bulk Loader or the Oracle Merge statement in a Stored Procedure.
Cheers,
Nige
Cheers,
Nige
- Tue Jun 06, 2006 4:52 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Jobs and Sequences
- Replies: 3
- Views: 1133
Re: Jobs and Sequences
[quote="NigeGriff"]Hi, is there an quick and easy way to find out what Jobs or Sequences are called by another Job Sequence? A DS_.... table that contains parent/child relationships would be nice. We use Datastage 7.5.1 Server Edition on Unix AIX. thanks, Nigel[/quote] The answers no then ...
- Mon Jun 05, 2006 10:17 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Jobs and Sequences
- Replies: 3
- Views: 1133
Jobs and Sequences
Hi, is there an quick and easy way to find out what Jobs or Sequences are called by another Job Sequence? A DS_.... table that contains parent/child relationships would be nice.
We use Datastage 7.5.1 Server Edition on Unix AIX.
thanks,
Nigel
We use Datastage 7.5.1 Server Edition on Unix AIX.
thanks,
Nigel
- Thu Jan 19, 2006 6:37 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Reading and Writing to the same hash file
- Replies: 2
- Views: 1408
Reading and Writing to the same hash file
We are using Datastage 7.5.1 on Unix AIX. We have a job that reads and writes to the same hash file. The job will lookup the hash file and if a certain criteria is met will then update that row setting an indicator. If the indicator is set then that hash file row should not then be used for future r...
- Wed Oct 12, 2005 4:54 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Excel functions for Normsdist and Normsinv
- Replies: 1
- Views: 702
Excel functions for Normsdist and Normsinv
Hi, we are running Datastage 7.5.1 Server Edition on Unix and have a requirement that we need to replicate a couple of Excel functions, namely Normsdist and Normsinv. Has anyone had to do anything like this?
Any help would greatly apprecitated.
Thanks,
nigel
Any help would greatly apprecitated.
Thanks,
nigel
- Mon Sep 05, 2005 2:27 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using ODBC stage accessing SQL Server Text field
- Replies: 8
- Views: 2826
Hi, instead of using the odbc stage we have used the DRS (dynamic relational stage) which has the needed long character support within, this is a new stage in 7.5. We also had to play about with the column metadata of the longvarchar field, because allowing it to default to 2gb for each column and t...
- Tue Mar 08, 2005 4:27 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using ODBC stage accessing SQL Server Text field
- Replies: 8
- Views: 2826
I have tried using substring and when using 8k (max length for substring)chunks the data runs through ok. The xml text is 68748 bytes long, and I have substring'd all of it and it comes through ok. The field is defined as longvarchar with a length of 2147483647. Is there a limit on the maximum field...
- Mon Mar 07, 2005 10:01 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using ODBC stage accessing SQL Server Text field
- Replies: 8
- Views: 2826
That was a quick reply. Thanks for that. I have just run through without the xml field and it runs ok. Then when stepping through using debug, I get down to the 18th record, then crash. The xml data for the 18th and other records around it look ok, but I can't check all, there are 1000's of bytes in...
- Mon Mar 07, 2005 9:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using ODBC stage accessing SQL Server Text field
- Replies: 8
- Views: 2826
Using ODBC stage accessing SQL Server Text field
Hi, I am currently trying to read a SQL Server table that contains XML in a field defined as text. The job is able to process some of the rows of data, but when reaching a certain row the job abends with 'Abnormal termination of stage ... detected'. I have imported the column metadata from the SQL S...
- Thu Sep 02, 2004 3:22 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Reading and writing arrays to and from sequential files
- Replies: 5
- Views: 1940
Processing Arrays
Thanks for the response. I have tried the CFF stage and it wants to flatten out the occurs (which it did incorrectly, but that's another matter). The problem I have is that the arrays are not a fixed number of occurances, and the processing I need to do, is at Customer level using the various array ...