need help for data migration
Moderators: chulett, rschirm, roy
need help for data migration
Hi All,
i am handling one data migration project. In the source there 54 database having around 900+ tables. now clients wants to migrate data (around 500+ table) in the target(db2) after transformation and apply business rule. For this they r planning to have one EDM in staging area. also they planned to use profile stage for cleansing, removing duplication and integration etc?
what i am thiking why EDM in staging area, it should be in target.
And also as far i know datstage server job is sufficent for data migration.
My question are
1-> Is there any benefit i can gain of using EDM in staging area ?
2-> Is DS server job sufficient for handling all cleansing operation or we need to have
profile stage for that?
i have little bit knowldege of data migration.
please help me!!
Any idea and suggestion will be very much help ful to me.
Thanks and Regard,
Rafiq
i am handling one data migration project. In the source there 54 database having around 900+ tables. now clients wants to migrate data (around 500+ table) in the target(db2) after transformation and apply business rule. For this they r planning to have one EDM in staging area. also they planned to use profile stage for cleansing, removing duplication and integration etc?
what i am thiking why EDM in staging area, it should be in target.
And also as far i know datstage server job is sufficent for data migration.
My question are
1-> Is there any benefit i can gain of using EDM in staging area ?
2-> Is DS server job sufficient for handling all cleansing operation or we need to have
profile stage for that?
i have little bit knowldege of data migration.
please help me!!
Any idea and suggestion will be very much help ful to me.
Thanks and Regard,
Rafiq
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
The EDM is in the staging area, which means data is moved from the old database into a staging area and then into the target. The staging database lets you keep data is close to raw form. It lets you track changes to the raw data over time. It lets you profile the state of that data. It is a good design as I assume they will have parallel systems for a while.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
ProfileStage does not perform cleansing - it is only an analysis tool. You need DataStage, and possibly QualityStage, to perform cleansing.
I prefer to use Sequential Files in staging areas, since they are written to and read from faster than anything else.
I prefer to use Sequential Files in staging areas, since they are written to and read from faster than anything else.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
The primary function of the EDM appears to be tracking changes to data over time, for the purposes of auditing and rollback. Whether you stage raw data or transformed data isn't a big deal. The process of staging can be beneficial for auditing, rollback and troubleshooting.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
![Embarassed :oops:](./images/smilies/icon_redface.gif)
A search turns up things like Electrical Discharge Machining and Essential Drugs and Medicine. Somehow, I don't think that is correct.
![Laughing :lol:](./images/smilies/icon_lol.gif)
Can someone throw me a bone?
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: