Page 1 of 1

Efficient way of copying rows and dropping columns

Posted: Thu Jul 20, 2006 7:51 am
by jzijl
Hello,

We have build a DS Job using the Transformer. The only thing which is done is retrieving data from a database on a MSS SQL Server drop columns and rows and write the result in another database on a MSS SQL Server.

My question is whether there is a more efficient DS-Stage than the transformer as there is no transformation done.

Thanks in advance.

Jan

Posted: Thu Jul 20, 2006 7:58 am
by kcbland
Sure, just write a SQL script and have DS execute it.

Posted: Thu Jul 20, 2006 10:07 am
by ray.wurlod
Why are you selecting those columns if you're only going to drop them? Don't select them in the first place!

Posted: Fri Jul 21, 2006 5:39 am
by jzijl
The question was not complete. I needed the dropped columns (date valid from and to) to determine wether I could drop rows.

Thanks all,

Jan

Posted: Sat Jul 22, 2006 12:41 am
by ray.wurlod
Just put a parameterized WHERE clause in your extraction stage, on the Selection tab.
WHERE eff_date BETWEEN '#DateFrom#' AND '#DateTo#'