DSXchange

Hi, My job is creates 12 million records which need to be agregate and then insert into the table. I am doing a pre-sort and using the sort order for the sorted columns. But when I use for 12 million records it abort saying row out of sequence. Whereas if I use it for few hundred thousand I is worki...

Hi,

Is is advisable to have a hash lookup with 25 millions rows or to have a db plugin stage.

kindly advise
Rasi

Hi Billy,

Merge stage is to join two Sequential File. If you are talking about the table then any database should have the functionality to do the union based on your select. Try the user definied query to solve your problem.

Cheers
Rasi

Hi Guys

Thanks for your answers

Without buying an additional tool. Can we do this in the operating system level in Unix. If so how to do it.

Cheers
Rasi

Hi All, Suggestion Needed for the following situation. I have Five Flat files(each are in 2-5 millions) in the same format which I need to insert into Single table after doing the aggregation. Database : DB2 ver 7 AIX Datastage : Ver 5.2 Question is what is the most efficient way of doing this. Foll...

Hi All,

We need datastage developer(Junior and Senior position) to work with us. If anyone is interested kindly send your resume to me. Location will be Asia Pacific and the start date will be 1 month. Salary will be negotiated based on your experience.

Thanks
Rasi

Send resume to : siva@yifan.net

Hi All, Just wondering about the performance with DB2. While inserting 15 million records into the db2 table it is took 2 days to finish it. The job uses db2 plug-in to insert records into the database. Is there any thing need to be checked to increase the performance. Also my other jobs which has t...

Hi All,

Did anyone tested datastage version 6 with db2 version 8. Is the db2 plugin in Dastage ver 6 has any new features. Also let me know the compability of dastage version with db2 version.

Thanks
Rasi

Hi,

What is the best thing in db2 while doing full refresh of a table. Is it better to drop the table and recreate it using datastage or simply truncate the table and insert records.

Thanks
Rasi

Hi All,

Is there any problem with DS Version 6 and DB2 Version 7 or 8.
Did anyone implemented datastage Version 6 with DB2 version 7.x or 8.x.

Thanks
Rasi

Hi,

You need to add XML Pack that comes with the CD. Once you installed you will see Two Plug-Ins(XML Reader and XML Writer).

Thanks
Rasi

Hi,

Use the Aggregrator stage in your job and in the transformation capture the required info you need to log. Inside Aggregrator use the last function to insert into the oracle table.

I am using this techique and it is quite efficient.

Thanks
Rasi

Hi, Hash files are basically used for lookup reference to make the fetch fast. To get the maximum performace while creating the file only select the columns which are required. Hash files can get corrupted. But always make sure that you can re-create the hash file with your job re-running. However t...

Hi

The latest version is 6.0. Also Ver 6.1 is released last week and check with your local Ascential Vendor for this release.

Thanks
Rasi

Hi,

It all depends what you want to do. If you want only the non-nulls to be considered in the average then it is the default. If you want the null to be counted as well then use the transformation to substitute the null value to 0 and send it to the aggregretor stage.

Thanks
Rasi