Search found 130 matches

by DSFreddie
Mon Dec 05, 2011 2:19 pm
Forum: IBM QualityStage
Topic: Match DataBase
Replies: 3
Views: 2179

Match DataBase

Hi All, While waiting for the Match Database to be created, i was reading some Quality Stage docs. I have couple of doubts on the way the Match Designer work. 1. Once we create the DSN & run the Match Test, are the output table getting created automatically ? Is it creating random names ? 2. If ...
by DSFreddie
Mon Nov 28, 2011 1:27 pm
Forum: IBM QualityStage
Topic: Match specification - Number of match specifications
Replies: 4
Views: 2446

Thanks Ray. Let me give you a somewhat closer scenario which will help you understand the requirement clearly. We have almost 80 iterations based on the below fields, SSN FN LN MN DOB Generation The records with exact similar SSN/FN/LN will be assigned a GROUP_ID. The records with similar SSN & ...
by DSFreddie
Mon Nov 28, 2011 1:08 pm
Forum: IBM QualityStage
Topic: Match specification - Number of match specifications
Replies: 4
Views: 2446

Thanks for your reply Ray eventhough I was not able to read the whole body of your message. :(

We are using IIS 8.5.1. As per the DB estimate size formula,the number of match specification makes a huge difference in the DB Size.
by DSFreddie
Mon Nov 28, 2011 9:40 am
Forum: IBM QualityStage
Topic: Match specification - Number of match specifications
Replies: 4
Views: 2446

Match specification - Number of match specifications

Hi All, Can you pls let me know how we can arrive at the number of match specifications for a particular requirement. The requirement is as follows, We need to group the exact similar records as well as closely matching records (based on different fields) & assign group ID for the records. Can I...
by DSFreddie
Fri Nov 25, 2011 9:40 am
Forum: IBM QualityStage
Topic: Question on the Match DB Size Estimation.
Replies: 0
Views: 1635

Question on the Match DB Size Estimation.

Hi All, I am trying to estimate the space required for the Match DB. The input data volume is around 6 million records. What are the points to be considered while doing this estimate. I got a formula like below, (number of match specifications x (match size + (match size x 10%) + frequency size) x r...
by DSFreddie
Mon Nov 21, 2011 7:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Re-group similar records grouped already
Replies: 2
Views: 1030

Thanks for the reply Chulett & Ray. I felt my first post is too elaborate & confusing. So, rephrased to make it simple. Ray, is there a way we can handle this scenario in DataStage ? As you said, we are planning to use Quality Stage for this requirement. Can you pls let me know what should b...
by DSFreddie
Mon Nov 21, 2011 12:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Re-group similar records grouped already
Replies: 2
Views: 1030

How to Re-group similar records grouped already

Hi All, Do you know how we can regroup the records which is grouped already ? I need to first group the records based on SSN/First Name/Middle Name/Last Name/DOB & assign GROUP_ID (which i did through sort stage-Key change column option & transformer stage variable). Now, the next step is to...
by DSFreddie
Mon Nov 21, 2011 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Grouping Logic - How to Re-group similar records
Replies: 1
Views: 993

Grouping Logic - How to Re-group similar records

Hi All, I have a requirement in my project as below - I need to group the same customer records into one group by assigning GROUP_ID's. See the example below, SSN FIRST_NAME MIDDLE_NAME LAST_NAME DOB 1234 DAVE W JONES 09/12/1970 0 DAVE JONES 09/12/1970 2345 JIM C NICHOLS 08/08/1967 2345 JIM C NICHOL...
by DSFreddie
Mon Nov 21, 2011 9:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Design Approach Scenario - Grouping Logic
Replies: 1
Views: 1005

Re: Design Approach Scenario - Grouping Logic

Hi All,

Any help with regard to this Design Approach scenario will be greatly appreciated as I wanted the thoughts/guidance from the DS experts to put a good design in place.

Thank You,
Freddie
by DSFreddie
Fri Nov 18, 2011 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Design Approach Scenario - Grouping Logic
Replies: 1
Views: 1005

Design Approach Scenario - Grouping Logic

Hi All, Good Morning. In one of my new project, I have a requirement as below, We have 2 files (One is Master-Full File & another file with Add/Delete/Update records). These 2 files has the following fields in it. SSN First_Name Last_Name Middle_Name DOB Generation The requirement is to group th...
by DSFreddie
Wed Nov 09, 2011 3:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding Similar records & assigning Groups
Replies: 24
Views: 13117

Re: Finding Similar records & assigning Groups

Thanks a lot all for all the inputs. It worked fine when i selected the correct partioning.

Regards,
Freddie
by DSFreddie
Sun Nov 06, 2011 10:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding Similar records & assigning Groups
Replies: 24
Views: 13117

Thanks Ray for your reply. Yes I am appending "G". Here is the output: ------------------------- 100 ABC 1 G1 100 ABC 0 G1 200 CDE 1 G1 200 CDE 0 G1 300 DEF 1 G2 300 DEF 0 G2 400 GHI 1 G3 400 DGI 0 G3 500 XYZ 1 G4 500 XYZ 0 G4 Here records with 100 & 200 key fields has come to the same...
by DSFreddie
Sun Nov 06, 2011 8:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding Similar records & assigning Groups
Replies: 24
Views: 13117

Hi Sura/Ray, Thanks for your inputs. I tried the following in the stage variable, StageVar : if not(DSLink3.keyChange) then (StageVar) else StageVar+1 In the new field GroupID, i passed StageVar. But it is not giving me the expected output. My output should look as follows, output ------------ 100 A...
by DSFreddie
Sun Nov 06, 2011 7:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding Similar records & assigning Groups
Replies: 24
Views: 13117

Thanks a lot Sura for your inputs. I did the first 2 steps. In the transformer, I didnt quite get what you explained using the stage variables. I am creating 4 stage variables in the order COUNT,SV1,SV2 & SV3. COUNT (first Stage variable) value = 0 What should I be doing for the rest ? (SV1,SV2 ...
by DSFreddie
Sun Nov 06, 2011 7:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding Similar records & assigning Groups
Replies: 24
Views: 13117

Logic Issue - Grouping distinct records (thru Transformer)

Sure Ray. I am planning to upgrade my membership in the near future. While trying to use the stage variables to check the Key Change values & assigning Group_ID's, I could assign distinct values to all 1's & 0's repectively. But my logic is not working in the scenario where i should be asssi...