Performance - Initial Load
Posted: Fri Jan 07, 2005 1:43 pm
We are in the early stages of implementing the PeopleSoft Enterprise Warehouse. We are starting with loading financial data from PeopleSoft Financials. Many of the tables we are loading have tens of millions of rows. Performance has been horrific.
We are using the PeopleSoft delivered ETL maps, but many of them end in error after running for over 24 hours. We are now trying to chunk the data to get it loaded, but we are still struggling.
What have you all done to get the initial data loaded? Did you use the ETL tool or did you use another method like straight insert select statements? Since Ascentials is the delivered tool for the PeopleSoft Warehouse, that's the way we'd prefer to load the data. However, we are open to exploring other options.
Thanks in advance for your advice.
We are using the PeopleSoft delivered ETL maps, but many of them end in error after running for over 24 hours. We are now trying to chunk the data to get it loaded, but we are still struggling.
What have you all done to get the initial data loaded? Did you use the ETL tool or did you use another method like straight insert select statements? Since Ascentials is the delivered tool for the PeopleSoft Warehouse, that's the way we'd prefer to load the data. However, we are open to exploring other options.
Thanks in advance for your advice.
