Loading Huge Data
Posted: Mon Sep 20, 2010 4:41 pm
I am having 10 files of same format and each is having 25 GB of data . So I need to load this 250 GB data into a teradata table . The table is not a multi set table and have one unique primary index .
I need to do some quality checks like date of birth is valid date or not .These quality checks can be performed from both datastage or teradata basic sql.
Which one of the below options is better and why
a) To read the files with file pattern from a sequential stage and load into teradata using multi load method .
b) Direcly write a multi load script and load into teradata table .
Thanks
I need to do some quality checks like date of birth is valid date or not .These quality checks can be performed from both datastage or teradata basic sql.
Which one of the below options is better and why
a) To read the files with file pattern from a sequential stage and load into teradata using multi load method .
b) Direcly write a multi load script and load into teradata table .
Thanks