Teradata load timings...
Posted: Wed Dec 01, 2004 3:21 pm
We are a divivsion of an Insurance company that is moving from UDB DB2 on UNIX to Teradata. This is because 2 Data Warehouse groups for 2 divisions are merging technologies. The other division has had Teradata but no Datastage. Our divsion has had Datastage for 4 years. The way that the other division has loaded data to the Teradata server is via MLoads, Bteqs, and Fast Loads running on the mainframe.
The other division is looking at the functionality of using DataStage to load directly to tables on Teradata, however they are thinking that FTPing data from the Unix box to a mainframe and then loading that data to Teradata from the mainframe is faster than having Datastage directly load the data to Teradata using Datastage's plug-ins.
Does anyone have experience with loading data via Datastage from a Unix box to a Teradata box? Does anyone have any thoughts that I might be able to use in a Proof of Concept I am working on?
We do not have parallel extender but could possibly install it if it would help increase the timing on these data loads to Teradata tables. A problem that we are facing on the Teradata server is that it will only allow 6 Multiloads to run at a time and we only have a certain window to run all of the multiloads we need to complete. That window is full, so we need to decrease the time it takes to run the loads.
Thank you
The other division is looking at the functionality of using DataStage to load directly to tables on Teradata, however they are thinking that FTPing data from the Unix box to a mainframe and then loading that data to Teradata from the mainframe is faster than having Datastage directly load the data to Teradata using Datastage's plug-ins.
Does anyone have experience with loading data via Datastage from a Unix box to a Teradata box? Does anyone have any thoughts that I might be able to use in a Proof of Concept I am working on?
We do not have parallel extender but could possibly install it if it would help increase the timing on these data loads to Teradata tables. A problem that we are facing on the Teradata server is that it will only allow 6 Multiloads to run at a time and we only have a certain window to run all of the multiloads we need to complete. That window is full, so we need to decrease the time it takes to run the loads.
Thank you