DSXchange

oh..!! come on...!!!
I need the solution not the reason ..LOL..!!

There was absolutely no reason to start a new post for this. Sorry if u cudnt find a reason for this new post..!! but need to mention my reason was... earlier post was just to know the diff between copy n transformer and easiest way to copy a .ds...!! i cudnt get wat i wanted...i mean i cudnt do it...

LOL..!!! 3. Ignore this task and ask for a file with 700 MN records only (from source system). If this is from a table, put the filter in ther SQL itself. Actually the file is an output of predeccsor job... so must perform many operations to control this... Anyways was trying many things since 2 day...

Fact table:It consists of foreign Keys and Measures(mostly Numeric values) Dimension:It provides descriptive information relating to the foreign key in a fact. Eg:- in employee table i have ename empid sal in manager table i have mname mid and sal so there are two dimension table 1--> emp table cont...

it was a .ds..!!

can u provide any other design..??

I have a .ds with 2.6billion records. is there anyway that i can copy only 700million into another file without processing all the records as it is taking a long time to process all the records. i have tried copying the file using a copy stage and it took 13hrs to process 2.6 billion(may be poor res...

Agreed..!! but.....fine leave abt that...

I ve tried both the ways.. and had to abort them...reasons being... both the cases...the processing started around 120-140k rows/sec and stable around 60k rows/sec. at this speed loading 2.6billion...???? my observation was the diff in comipiling time... processing time both took almost the same row...

ya..the simple design can easily be done..
but my questions are unanswered..
is it the same process time for both..?
how are 'light weight/ heavy' terms justified..??
what damage does it do when we use transformer instead of copy..?

and regarding using dataset management tool...we may copy that .ds but it wont copy the reference nodes through which data is loaded into .ds (that means it may not copy the appropriate data)

correct my understanding if im wrong..!!

could u plz be a little elaborative...
i mean transformer in 8.1 is far improved compared to older versions...
does this really effect on the performance if use transformer..??
cons and pros in using it..?

i have a .ds file with 2.6billion records. i just want to have a dump of this file. i can use a copy stage but just my curiosity can we use a tranformer in place of copy..?? i know that transfomer is robust and compiles in C++ then orch.. but is the same process time for copy and transformer..?? as ...

I have a job which just funnels about 1billion records from a .ds and around 202million records from another .ds When the job is running for one and half hour(around900M rec), its getting aborted with the following error. Note: Funnel is followed by a sort. As per my knowledge this type of error usu...