DSXchange

Thanks Istsaur..

I underatand the requirement is to get Select priveleges to these sys tables..

So how & why does it allow to write (insert) data to the same table w/o these privileges

Hi, When I try to use Oracle Enterprise Stage for extracting data from a table, it throws an error saying "Access to sys.dba_extents is required but not available". I understand that it needs to access to certain Oracle Sys tables for this. But when I use the same userid to write to the sa...

Hi, How does DSEE Remote deployment work? Does all the data as part of the job move between the Server location and the remote location or it just the commands? Also any other constrainst for the same? NV **NOTE** Thread moved by editor to EE forum, but it has already been re-posted, so please ignor...

Hi,

Has anyone tried using CRC32 in Parallel version by wrapping the code in a BuildOp since we do have this function in PX (only in server edition)?

NV

Thanks DSGuru2B. I am at client location and currently do not have access to Datastage. Offcourse, I will perform these benchmark tests as soon as the set up is ready. The only reason I ask is, if some has already done a similar analysis, it can be leveraged by others. My 2nd question meant that, if...

Kumar, thanks for your prompt respomse.

2 questions:
1. Is creating a Seq file faster than creating a Dataset from a DB table?

2. Would the process of creating datasets from a RDBMS be faster than teh process of comparing them using the CDC stage ?

Hi,

What is operator used for in the CDC stage?
Since all of the operators are written in C++, would it be correct to say that they internally use functions/logic or the algorithms inbuilt in C++ to compare the 2 datasets?

Regards,
NV

The record size could be like 500-600 chracters..(15 cols) We have 293 million rows of this size and we need to find the changed data using Change capture? maybe around 450 GB of data So there will be 2 datasets with these many rows...We have max 8 nodes at our disposal.. So what kind of approx time...

well we are actually to trying to replace the current Sybase Replication process by ETL..that is the chalenge

has 150 columns with each on an average 25 characters per column...would also include some numeric cols as part of this 150 cols
so around 3500 characters per row..

Hi,

Has anyone tried to copy around a few million rows with each one having 100-150 columns in to a Sequential file or a dataset from a Sybase table. No data transformation required.

How much would the file size be aproximately?

Regards,
NV

Thanks DSGuru2B for your prompy response. Is CDC plug-in stage available for ASE server (Sybase) and how does it achieve it? Join stage, how would you achieve CDC using it? Most importantly what is the impact on performance as we talking high volumes here? Doing it at the DB level is not the option ...

Hi All, We have a requirement where we have to capture changed data from a Sybase server. It is a Read Only server and everyday a SAN Snapshot (Backup) of the Production data is dumped in it (around 22 Million rows). Not all tables have a As-of-Date or any such date field to be able to track the cha...

Thanks Ross for your prompt response.

We are looking at around 1 TB data volumes..
Also would Delete then Insert instead of update be slow too?

Regards,
NV

Hi,

Has any one faced any problems when trying to update a Sybase IQ table from Datastage uisng an ODBC stage as it has a Column based architecture and not a row based one like other RDBMS.
Any specific way to handle this, if any?

Regards,
NV