Bulk Loaders in DS

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
palaniappan
Participant
Posts: 41
Joined: Wed Mar 05, 2003 1:28 am

Bulk Loaders in DS

Post by palaniappan »

Hi,

A document that I was browsing through says that DS supports bulk loading utility for Oracle, Informix, Sybase Adaptive Server, Sybase Adaptive Server IQ, MSSQL, Redbrick, and IBM DB2 UDB.

I know that it supports Oracle, DB2 and Informix. Is the rest of the information creditable? What other bulk loaders does DS support?

Thanks, Pal.
Top
dsrules
Premium Member
Premium Member
Posts: 76
Joined: Sun Nov 28, 2004 8:56 pm

Post by dsrules »

Include TeraData in it.

dsrules.
______________________________________
"Everytime I close the door on reality, it comes in through the windows." - Jennifer Yane
Top
Luk
Participant
Posts: 133
Joined: Thu Dec 02, 2004 8:35 am
Location: Poland
Contact:
Contact Luk

Post by Luk »

Hi !
Sybase ASIQ is also suported! Plug-in creates flat file wchich is later load into database.

LUK
Top
ogmios
Participant
Posts: 659
Joined: Tue Mar 11, 2003 3:40 pm

Re: Bulk Loaders in DS

Post by ogmios »

The bulk loaders (personal experience with DB2 and Oracle) are remarkably slower than running them outside of DataStage... upto 10 times slower and more.

Ogmios.
In theory there's no difference between theory and practice. In practice there is.
Top
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:
Contact kduke

Post by kduke »

You can easily run these outside of DataStage by writing shell scripts. DataStage can generate the control files needed for any of these. If you think they are slower then update a flat file and then run a shell script to bulk load. Let us know the results. I would like to know which is slower and by how much.
Mamu Kim
Top
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Contact ray.wurlod

Post by ray.wurlod »

The only Red Brick stage in DataStage is the bulk loader stage. :wink:

Says something important about purpose-designed DW databases, I feel.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Top
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:
Contact vmcburney

Post by vmcburney »

Often it is not the bulk loader that is slower but the creation of the data files. You can save time by creating the data file with a sequential file stage and then calling the bulk loader externally.

I have all the Standard Edition RDBMS plugins loaded, I can see DB2/UDB Load, Informix Load and Informix XPS Load, Oracle 7 Load and Oracle OCI Load, Redbrick Load, Sybase BCP Load and Sybase IQ 12 Load, Teradata Load and Teradata Multi Load. It's a Unix installation so I don't see an MSSQL Load.
Top
Post Reply

Return to “IBM<sup>®</sup> Infosphere DataStage Server Edition”