Page 1 of 1

Performance Tune Teradata Load

Posted: Thu Sep 25, 2008 1:06 pm
by horserider
Reading a mainframe binary file using a CFF stage and simply dumping 5 million rows to a teradata table using Enterprise Stage. Takes anywhere 35-40 minutes to load. No transformation is happening.

(1) Any way to reduce the load time?
(2) Is Enterprise Stage the best way to load 5 mil rows in teradata table?

Posted: Thu Sep 25, 2008 4:58 pm
by John Smith
Well you need to do your own benchmarks then. As a general rule the Enterprise stage is supposed to be the fastest as it is based on Teradata Fast Load. To tune it you may need to engage your Teradata DBA as Teradata do provide a number of ways of tuning your data loads.

Re: Performance Tune Teradata Load

Posted: Fri Sep 26, 2008 11:05 am
by thamark
Enterprise stage will be much faster and in fact it may take only few minutes or even less and I hope this is just an truncate and load to the table.

Posted: Mon Sep 29, 2008 6:46 am
by toshea
Try setting the requestedsessions option to a smaller value. It defaults to the number of AMPs on your server, and the number of player processes is computed by requestedsessions divided by the sessionsperplayer. If you have a lot of AMPs, it results in too many player processes all competing to update the terasync table. Set requestedsessions to a smaller value like 8. How many nodes do you have in your PX config file? Optimally, you'd want to set requestedsessions to the number of nodes multipled by sessionsperplayer. That way you will not have any repartitioning.

Posted: Mon Sep 29, 2008 8:11 am
by venkatvelpula
Try to write that into sequentail file and load it from there..It's not optimum solution but it might work for your case.