Why do you have 16 output files?
The Teradata Enterprise stage invokes FastExport which produces 1 answer set. All the parallel processing is performed on the Teradata Server not in DataStage.
For 1.4 M rows I've seen better throughput using the Teradata API stage.
Search found 15 matches
- Wed Jan 31, 2007 12:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6524
- Fri Nov 11, 2005 6:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error writing to Teradata Enterprise Stage
- Replies: 11
- Views: 8222
- Thu Sep 29, 2005 8:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to pass job parameters in parallel tranformer stage
- Replies: 12
- Views: 9391
- Thu Sep 29, 2005 8:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to pass job parameters in parallel tranformer stage
- Replies: 12
- Views: 9391
- Thu Aug 11, 2005 2:49 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sparse Lookup
- Replies: 4
- Views: 3615
We ran into a problem with the Oracle sparse lookup when returning a numeric field for matched records the value was always zero. I just received a patch from Ascential support to fix this problem but have not applied it yet. The patch is for v7.1. If the field being returned is char then the proper...
- Fri May 27, 2005 7:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata write created hundreds of sessions
- Replies: 3
- Views: 4804
The 16 requested sesions is a rule of thumb I use for a Teradata system with more than about 100 VAMPS. Because the default setting in Fastload, MultiLoad, and FastExport is 1 session per VAMP I try to limit the number of sessions that my job starts to reduce start-up time. The sessions per player I...
- Thu May 26, 2005 2:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata write created hundreds of sessions
- Replies: 3
- Views: 4804
It would be unusual to have a 7 AMP Teradata system. The number of AMPS is usually an even number; 7 nodes would be more likely. This would translate into x-number of AMPS; actually VAMPS. When the Teradata Enterprise stage is used for writing it runs the Teradata FastLoad utility. The default numbe...
- Thu May 26, 2005 2:24 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Terawrite worked once, now won't work again
- Replies: 5
- Views: 5148
This is a known problem in DataStage v7.1: 9 WARNING Tue May 24 09:40:47 2005 Teradata_Enterprise_12,2: TeraSession: cli rejected buffer write, stall #0 of 0. [terasession.C:1001] 10 FATAL Tue May 24 09:40:47 2005 Teradata_Enterprise_12,2: TeraUtils:Put failed: Error Code = 204 [terautils.C:2631] Ec...
- Thu Apr 14, 2005 2:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Creating config for accessing Teradata
- Replies: 11
- Views: 12664
You need to look at the Orchestrate doc to get info on this. Here's a snip from the manual. You would code the sessionsperplayer and the requestedsessions parameters on the connection string in the Teradata Enterprise stage but you have to select user defined connection string. This is from the Orch...
- Thu Mar 24, 2005 9:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataStage and SUSE Linux?
- Replies: 4
- Views: 2236
- Mon Jan 24, 2005 2:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: multiload utility in Parallel mode
- Replies: 16
- Views: 11382
- Mon Aug 23, 2004 8:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Version 7.1r1 upgrade problem
- Replies: 2
- Views: 2020
Re: Version 7.1r1 upgrade problem
I just went through this problem with Ascential support. It requires an upgrade for the PXEngine.
I believe that the problem has to do with columns that were used as sort columns and not carried through the remaining stages.
Contact Ascential support for the fix for ecase 50039.
I believe that the problem has to do with columns that were used as sort columns and not carried through the remaining stages.
Contact Ascential support for the fix for ecase 50039.
- Fri Nov 07, 2003 9:21 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to import table defination for a Teradata table
- Replies: 8
- Views: 6483
You do need the Teradata Client utilities installed on the DataStage server. Of course you need them for doing any Teradata access from DataStage; or at least the Teradata ODBC driver with a DSN configured. Here is the procedure: In Designer, right click on Table Definitions, click Import, click Plu...
- Wed Nov 05, 2003 2:10 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to import table defination for a Teradata table
- Replies: 8
- Views: 6483
- Mon Oct 13, 2003 2:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How Many Stages in a PX Job
- Replies: 3
- Views: 4234
How Many Stages in a PX Job
Based on how PX creates UNIX processes, one for each parallel stage X the number of nodes, should there be a limit on the number of stages in a PX job and what should it be based on?