DSXchange

Thanks Ray for your input.

I will try using ODBC Enterprise stage then.

Regards
Elavenil

Hi, We are in the process of setting up the development environment for our data warehouse project. DataStage 7.5.1A EE has been installed in the server and we have configured Oracle database in the ETL server and we need to connect SQL server database as well. I could not find any tips to configure...

Thanks for your response.

Regards
Elavenil

Hi, We are in the process of defining the process required for a DW implementation. For the reconciliation purposes, we read link information using DSLinkGetInfo to get row count of this link that are available in the extraction, transformation jobs. Load count is extracted from target database. I h...

We are in the process of starting the DW project for one of the bank. DataStage EE licence has been purchased and we are planning to use Windows OS for the development and AIX for production. I would llike to have the following info when the jobs are migrated to prod from devt environment. 1. Parall...

We had a similar problem in my earlier project so check the file size limit for the user that is used to execute the job. And lookup table size might have crossed that limit. Solution would be increase the limit for the user and execute the job.

HTWH.

Regards
Saravanan

Thanks Anupam for the response.

I thouht deletion of the hashed file is faster than clearing a file. Can you just pls share your experience why hashed files cannot be deleted.

Regards
Elavenil

Thanks Arnd for your response.

Yes. The hashed file is deleted and recreated at every run.

Checked the data and no control characters are found. Is there any way to handle this situation?

Regards
Elavenil

Thanks Kumar for your response.

Both are run with the smae user id. They are not accessed parallelly.

Regards

Thanks Ray for your response. Checked those two points and i did not find anything wrong in the value of key field. At the same time, if some special characters in the key value, then that record writing should consistently fail but it is not. When we reran the job it got over successfully. Can you ...

Hi, We encountered Write failed for record id <Key Column Value> while writing the records into hashed file. Hashed file is dynamic hashed file, and other parameters are default. The same job without any modification on data and job ran fine. We checked the file size and it is not more than 2 GB and...

There are few ways to eliminate duplicates in a server job. Load data into hashed file (define the key) and load into target as hashed file will not allow duplicates. Stage variables/aggregation stage can be used to eliminate duplicates as well.

HTWH.

Regards
Elavenil

Database aggregation should be good compare to DS aggregation if data volume is very high. So database aggregation is recommended when the input data volume is very high.

HTWH.

Regards
Elavenil

Do outer (left/right) join of those two tables and check the other table values to identify (un)matching records then populate the column that you want to derive.

HTWH.

Regards
Elavenil

Thanks for your responses. I will try measuring/analysing the performance factors as you guys suggessted.

Regards
Elavenil