standardization

vasubabu · Post by **vasubabu** » Wed Nov 05, 2008 5:42 am

Hi,

I have developed standardization job in Quality stage and implemented that job in Datastage.

job is running fine. but it is processing only 5 rows per second.

Could any one help me to improve the performance.

Job is to standardize a name.

Thanks,
Vasu

ray.wurlod · Post by **ray.wurlod** » Wed Nov 05, 2008 7:27 am

We don't wave magic wands. With no idea about what your job design does and how it does it, it's impossible to suggest anything.

vinnz · Post by **vinnz** » Wed Nov 05, 2008 3:11 pm

Vasu,
Please include details about rulesets used, amount of data being processed and if you get the same poor performance when you run the demo jobs that come with QS.

vasubabu · Post by **vasubabu** » Mon Nov 10, 2008 1:15 am

Input file is having 53 columns. Total number of records in the input file is 8435.

Standardization is done for a single column (Name) using AUNAME ruleset.

In datastage this job is processing only 5 rows per second.

Please help me to improve the performance.

Thanks in advance.

ray.wurlod · Post by **ray.wurlod** » Mon Nov 10, 2008 6:52 am

How wide are the records (not 53 columns, but how many bytes)? What else is happening on the system at the same time? How much elapsed time (and rows/sec if you must) does the Standardization stage report in the Monitor? What is the total volume of data processed? Please describe the entire job - the bottleneck may be elsewhere.

Nagaraj · Post by **Nagaraj** » Wed Nov 12, 2008 10:43 am

Can you please provide me some documents or manual on how to use qualtiy stages with examples.
i have the pdf's from IBM which doesnt give me a good understanding.

ray.wurlod · Post by **ray.wurlod** » Wed Nov 12, 2008 11:12 pm

No. Any such documents I may have produced are restricted by non-disclosure agreements with the clients for whom I produced them. I think you will find this to be universal among consultants.

Nagaraj · Post by **Nagaraj** » Wed Nov 12, 2008 11:32 pm

Okay thanks Ray,

I was just hoping that i will get some information from your side.

stuartjvnorton · Post by **stuartjvnorton** » Thu Nov 13, 2008 5:48 pm

Nagaraj wrote:Can you please provide me some documents or manual on how to use qualtiy stages with examples.
i have the pdf's from IBM which doesnt give me a good understanding.

There isn IBM Redbook that has a couple of examples that are investigated in exhaustive fashion:

http://www.redbooks.ibm.com/abstracts/sg247546.html

Not much good for learning the in's and out's of every switch or flag (which I am still hoping to find somewhere), but good if you want some meaty walk-throughs of QS.

All that said: without the software to use, this won't help a lot. There is no easy way to really understand a product like this. You just have to use it.

Nagaraj · Post by **Nagaraj** » Thu Nov 13, 2008 5:53 pm

Thanks i read this PDF and got more confused thats why was asking some user documentation.

Nagaraj · Post by **Nagaraj** » Thu Nov 13, 2008 5:54 pm

Thanks i read this PDF and got more confused thats why was asking some user documentation.

stuartjvnorton · Post by **stuartjvnorton** » Thu Nov 13, 2008 6:51 pm

Nagaraj wrote:Thanks i read this PDF and got more confused thats why was asking some user documentation.

Try the standard IBM QS tutorial: it's a good start to understanding QS and what most people here would have done at some point. If you have specific questions, ask and people will answer if they can.

stuartjvnorton · Post by **stuartjvnorton** » Thu Nov 13, 2008 6:56 pm

Nagaraj wrote:Thanks i read this PDF and got more confused thats why was asking some user documentation.

Try the standard IBM QS tutorial: it's a good start to understanding QS and what most people here would have done at some point. If you have specific questions, ask and people will answer if they can.

Nagaraj · Post by **Nagaraj** » Thu Nov 13, 2008 7:24 pm

Thanks for the information...where i can find the QS material, the pdf which comes with the product.

stuartjvnorton · Post by **stuartjvnorton** » Thu Nov 13, 2008 10:51 pm

Nagaraj wrote:Thanks for the information...where i can find the QS material, the pdf which comes with the product.

Asked and answered