We are in the early stages of implementing the PeopleSoft Enterprise Warehouse. We are starting with loading financial data from PeopleSoft Financials. Many of the tables we are loading have tens of millions of rows. Performance has been horrific.
We are using the PeopleSoft delivered ETL maps, but many of them end in error after running for over 24 hours. We are now trying to chunk the data to get it loaded, but we are still struggling.
What have you all done to get the initial data loaded? Did you use the ETL tool or did you use another method like straight insert select statements? Since Ascentials is the delivered tool for the PeopleSoft Warehouse, that's the way we'd prefer to load the data. However, we are open to exploring other options.
Thanks in advance for your advice.
Performance - Initial Load
Moderators: chulett, rschirm, roy
Re: Performance - Initial Load
If you experience errors everytime around 24 hours of runtime, I would consider disabling timeouts via DataStage Administrator.
Ogmios
Ogmios
In theory there's no difference between theory and practice. In practice there is.