Address Cleansing in DataStage ???

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
badhri
Participant
Posts: 42
Joined: Tue Mar 19, 2002 8:15 pm

Address Cleansing in DataStage ???

Post by badhri »

Greetings,

Does DataStage supports Address Cleansing/Parsing Functionalities. I am looking for functioanlities like Address De-duplication as available in the Data Cleansing.

I find that that new ETL tools also have the Data Cleansing coupled to them.

Thanks in Advance.

Badhri ...
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Unless you write them yourself, you'll need to invest in another part of Ascential's Suite - in this case INTEGRITY XE which is their 'Data Quality & Cleansing' component.

-craig
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Excellent advice! Everyone I know who's tried to write it themselves has ended up acquiring other specialist software. It's a really ugly task!
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Well, not to toot my own horn or anything, but I *have* written an address parsing and normalization routine which is working pretty darn well for us, all things considered. <g> However, for large data sets and other quirky address things like the 'de-duplication' features that badhri mentions, you really need to look at something like INTEGRITY. I've seen the dog-and-pony show and its feature set was quite impressive.

-craig
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Does yours do non-US addresses? :)

Congratulations on reaching 50 posts, BTW.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Oh, goodness no. And thanks!

=;^)
Post Reply