ETL/DataStage Processes ..Health care Industry ???

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

ETL/DataStage Processes ..Health care Industry ???

Post by Developer9 »

Hello Everyone,

Currently I thought of shifting to my domain Banking to Health care industry

Code: Select all

Environment :DataStage Enterprise edition(8.1),Oracle,UNIX 

Can you please share your thoughts or suggestions about the Health care industry ETL Processes ??
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

Data comes from this database... get's transformed over here.... then goes into that database. The only difference is that if you mess it up, someone might die.

That's it.
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Post by Developer9 »

Thanks Paul
:)

I am looking at a technical point of view of data or methodologies ???
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

So is Paul.

What would you expect to be different as far as ETL processes are concerned? They are specified by business analysis and the like and implemented by you.

There is a different underlying model, but that ought not to be the concern of an ETL developer.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Post by Developer9 »

Thank you Ray,

It makes sense to me that understanding the data (metadata)is some thing different for different domains .. and as an ETL Developer role, the processing on the data is based on business requirements ..
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Privacy is a big concern everywhere. In healthcare especially, at least in the U.S., there are more regulations around protecting privacy. Search on the "HIPAA Privacy Rule."

Personally, I'm more concerned about learning and applying the rest of the tools in the Information Server suite (besides DataStage) than focusing on any specific industry.
Choose a job you love, and you will never have to work a day in your life. - Confucius
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

True, between HIPAA, PHI & PII there's plenty of privacy issues to be aware of in the Healthcare industry. The people you work for will make sure you understand what those are. But bottom line, that doesn't mean there are any real "technical" differences or magical methodologies that you'd use in one industry but not another. Typically. Yes, you might need to learn more about masking or encryption in Healthcare but it is certainly not exclusive to that world. Sure, there will be nuances of differences with how data is transmitted or what file formats are used or how many jigabites of data you need to load every day but there's still a bottom line.

As has already been said, ETL is ETL. This may sound a little facetious but you are going to E something, then T it and then finally L it. Or maybe you reverse the order of the last two, doesn't really matter. A database is a database, relational tables relate in a similar manner and there's only so many ways to load a warehouse or mart or ODS or whatever. Do you handle a Type2 dimension differently for Healthcare than Banking? Do inserts differently? Validate dates / amounts / strings of random digits differently? No, not really.

Of course, an understanding of the underlying business can help. Having to explain to someone building a financial data warehouse what a debit is or what posting a general ledger entry does can be a little frustrating but does that mean they can't be perfectly capable of moving the data from the source to the target with all of the proper business requirement transformations in place? Nope.

Learn the tools at your disposal. Become adept in their use regardless of industry or application. The rest will come. Well... unless you switch to working with geospatial data or start plotting vectors in a Hilbert space that is. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I guess the health care industry might work more with masked data and generated test data than many other industries, at least in development environments.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kandyshandy
Participant
Posts: 597
Joined: Fri Apr 29, 2005 6:19 am
Location: Singapore

Post by kandyshandy »

PaulVL wrote:The only difference is that if you mess it up, someone might die.That's it.
That was a good one :)

OP,
For me, it really does not matter for an ETL consultant or developer working across industries/domains. Terms will be new for you initially, but processes will be the same. You will become familiar with their domain in couple of weeks. So nothing to be prepared.
Kandy
_________________
Try and Try again…You will succeed atlast!!
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

ray.wurlod wrote:I guess the health care industry might work more with masked data and generated test data than many other industries, at least in development environments.
True, but I would imagine the Banking industry has similar privacy concerns...
-craig

"You can never have too many knives" -- Logan Nine Fingers
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I don't know if the industry has any concerns other than turning a profit, but I know the customers have such concerns! :!:
Choose a job you love, and you will never have to work a day in your life. - Confucius
FranklinE
Premium Member
Premium Member
Posts: 739
Joined: Tue Nov 25, 2008 2:19 pm
Location: Malvern, PA

Post by FranklinE »

Being familiar more with the banking side -- my first career was in insurance -- I observe one significant difference: record format standards. I mean by this that a personal info record, for example, will look very different from one shop to the next.

Banking has global standards around transmissino of data. The most common is SWIFT, and many "local" applications comply with it to a significant extent.

Insurance -- and I know from friends currently in health insurance that it is true now -- has no such standards. One can look from one region of the country to another, let alone one company to another, and find very different formats.
Franklin Evans
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson

Using mainframe data FAQ: viewtopic.php?t=143596 Using CFF FAQ: viewtopic.php?t=157872
Sivacharan Irukulla
Premium Member
Premium Member
Posts: 5
Joined: Mon Apr 09, 2012 8:44 am
Location: Chennai

Post by Sivacharan Irukulla »

I too shifted from Banking domain to Health care domain :), there will not be much difference in the ETL process, we will miss the domain level knowledge. But once we start working, it becomes so simple.

There will be so many sub domains which we can fall under, for example Pharmacy,Corporate,Sales reports and quotes - all these are mainly related to customers,premiums,broker transactions.

I hope masking the data will be every where as one of the guys said its upto the client whether to dispose its customer data or not. :wink: :wink:
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

PaulVL wrote:The only difference is that if you mess it up, someone might die.
The ISD manual specifically defines a real-time web service as "someone's life does not depend on it." I guess ISD is not designed to handle web services inside a pace maker or air traffic control tower...
Choose a job you love, and you will never have to work a day in your life. - Confucius
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Most Blue Cross Blue Shield use DataStage. They are very loyal to IBM and IBM products. Most mainframe shops are IBM first shops. So banking are also mainframe shops. This tends to be true across hospitals and pharmacies. The doctors offices tend to be Windows or UNIX.

Claims processing is very complex and knowledge of data structures and terminology is very useful to obtaining a job. Knowing what a PCP, UCR, fee schedule, PPO, HMO and other industry terms helps. There are lots of privacy issues to be concerned about as well.

The more complex an industry the better the pay and more likely you will have a job years from now.

So manufacturing is big. SAP and PeopleSoft are other smart moves if you are looking for complex software that crosses industries.

I think it is very wise to plan a long term strategy like what industry you want to work in and what products you want to tie yourself to.
Mamu Kim
Post Reply