DSXchange

Hi, Our current data warehouse Datastage applications are using MS SQL Server 2000 as backend database and we are in the process of migrating to Oracle 10g. We found an issue while System Testing. We have jobs that are reading from Complex flat file and loading it into ORACLE ODBC stage. For a parti...

samsuf2002 wrote:Surrogate key generates random sequence key ,its normal .If you want exact sequence key like 1,2,3..... instead of 2, 4, 6... then you need to do Round robin partition

Thanks samsuf2002.

By partitioning in "Round-Robin", it worked fine.

Thank You.

I am using Surrogate Key Generation stage to generate surrogate id's. I have a total of 927257 records with distinct business key. For each business key i am assigning the surrogate id. When i query the database after the surrogate key generation, i see the maximun of surrogate id is 927766. When I ...

Hi All, I have 3 jobs running Sequentially in a Sequence. The second job runs (parallel job) with acceptable warnings for the intial run. The consecutive runs will not have warnings for the same job. I would like to specify in the Trigger OK - (Conditional) or Warning - (Conditional) How should i do...

ray.wurlod wrote:20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Is it 20TB or 20GB?

20TB seems to be very huge.

Thanks in Advance.

ray.wurlod wrote:20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Thanks Ray.

Hi All,


We are trying to store large volumes of data (> 9 Million records) in either a DataSet or in a Lookup File Set for doing a lookup.


Is there any Size limitations with DataSets & Lookup File Sets?

Are there any known issues appending data to DataSets?


Thanks in Advance.

Are the links in the job (one input to and one output from the shared container) named the same as the links from and to the Container Input and Container Output stages? If so, are they carrying the same metadata? Even if not, the Validate tool (drop down list should contain link names) can get the...

I guess, its your output dataset points to the After Dataset as input, and hence it might be showing as Copy. Kumar, In my change Capture Change stage, i had specified the drop option to True for the copy. So i should not be getting any records out of the Change Capture stage, when the records are ...

What are you doing with the records downstream of the Change Capture stage? In particular, are any records loaded into the Teradata table (thereby to become a populated "before" data set)? Ray, I have a transformer after Change Capture Stage. From the transformer i 2 links going out. The ...

I have data coming from Teradata table as Before DataSet. I have data in a DataSet as After DataSet. I am trying to do a change capture. When I run the job for the first time, Before DataSet is empty, and the change_code is 1 and job gives me the records to be inserted. The issue is, when I rerun th...

While performing a lookup i am encountering the following warning: Lookup_54: When checking operator: Dropping component "CLIENT_ID" because of a prior component with the same name. My Source fields & Reference fields have same column names. How should i aviod this warning? Thanks in A...

chulett wrote:And saying 'per user' is a little bit of a misnomer - it would have been more proper for me to say per installation of the Director.

Thanks chulett.

chulett wrote:Director: Tools / Options / Limits - set it there. Keep in mind that this is not a global setting, but is a per user setting.

In was asking with respest to the global setting. Anything in DataStage Administrator .. or some where else..

Thanks in Advance.

A script or 'wrapper' process that uses dsjob to run the job rather than using the Director to run it. That script can have the "-warn 1" in its command line to enforce that rule. The only other way would be to change the default in the Director so that it defaults to aborting after 1 war...