DSXchange

How much time would a PX job involving The Change Capture Stage take where the before and after datasets are both having around a million rows?
Should this process take more than 30 minutes on a 2 node machine?

Kumar,

How could we trap the changes via the Database log?
As I mentioned earlier it is straight dump of the SAN Snapshot on the existing data..so basically all the data in the Sybase server gets
over written each time.
Would the database still maintain the logs?

well we are exploring the solution through ETL..
it is preferred by them.."Client"!!

Kumar, There are no predefined rules for capturing teh changes..that is the challenge. Back up of the entire Production DB is taken on the Sybase server (source for our ETL process) every 12 hrs..so we have to capture only the changes in betwen these 2 back ups and the load in the target Sybase IQ s...

Thanks Kumar.. We are using 7.5.1 (Enterprise edition..Parallel). As I have mentioned in my first post, we do not have the luxury of having date time fields..so life is going to be tough!! We have implemented change data capture in another project..the volumes was pretty low there though. My main ar...

tr worked for me.

tr -d '\r' < FILENM > FILENM.dos2unix

thanks to all.

Although server object code is portable the same does not apply to any c++ objects or PX jobs. Step (1) is necessary Step (2) means you need to recompile and bind your object library for customer routines Step (3) looks like missing object code. Did you do a FORCE recompile? 1. I compiled the cc co...

Hi, We recently migrated the DS parallel server from Linux to Sun Solaris machine. Issues faced were 1. need to compile every DS object and c++ code. Is there any other way out? 2. The jobs that refer to custom routines is having problem during execution. we used g++ compler on linux to compile cc c...