informatica to ds

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
king999
Participant
Posts: 7
Joined: Thu Sep 29, 2005 3:46 pm

informatica to ds

Post by king999 »

is there any kind of tool that can convert an already existing informatica mappings to datastage jobs. if anyone is working in this kind of environment their information in this topic would be appreciated :D
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

There are quite a few tools who can help in converting from Informatica to DataStage, but they usually need to be paid by the day and need care & feeding as well. Some of them lurk in here, too.

Unfortunately there is little in the way of commonality between the two products; at least nothing that lends itself to automated procedures and programs. The metadata can be re-used, as can some of the job design concepts {particularly when porting to PX} but that's about it.
king999
Participant
Posts: 7
Joined: Thu Sep 29, 2005 3:46 pm

Post by king999 »

thanx for reply can u name some tools
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

King999,

sorry I wasn't more precise - there are no software tools, just people-power. I was referring to consultants that often post in here in my previous post.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I am not aware of any tools, in either direction. One of the reason for the lack is that the two products take a different approach to solving the task of ETL - simplistically, DataStage takes a "top down" approach (draw the picture, then fill in the details), while Informatica is more "bottom up" (design the maps, then put them together).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Ascential set up a team of developers to convert PeopleSoft EPM customers across from Informatica to DataStage when PeopleSoft changed partners on the embedded ETL engine. I have heard this team had an Informatica to DataStage converter that did up to 90% of the conversion work, with the remainder done manually (and possibly the last 10% taking a lot longer then the first 90%). However this was a DataStage Server job converter. This same team also had to do some PeopleSoft implementations for clients who upgraded to Enterprise Edition. I understand they also have a server job to parallel job converter!

I don't fancy your chances of getting to use these converters unless you are a PeopleSoft customer, but you could always contact Ascential support and see what they can do.

Even if you had the conversion tool you will find two things
- Quite often you will find your job needs a complete redesign given the way parallel jobs work and it is easier to rebuild it using existing documentation and the Informatica job as a guide.
- Your jobs and job control are not inherently maintainable, even if produced by a conversion tool. You still need a DataStage expert who is experienced with job control, error handling, partitioning, custom stages etc.
RAJEEV KATTA
Participant
Posts: 103
Joined: Wed Jul 06, 2005 12:29 am

Post by RAJEEV KATTA »

Hey King,
Jobs from Informatica to DataStage can be converted using DataStage MIgrator tool(IBM Asc tool).But the jobs would be converted into server jobs.

Cheers,
Rajeev.

vmcburney wrote:Ascential set up a team of developers to convert PeopleSoft EPM customers across from Informatica to DataStage when PeopleSoft changed partners on the embedded ETL engine. I have heard this team had an Informatica to DataStage converter that did up to 90% of the conversion work, with the remainder done manually (and possibly the last 10% taking a lot longer then the first 90%). However this was a DataStage Server job converter. This same team also had to do some PeopleSoft implementations for clients who upgraded to Enterprise Edition. I understand they also have a server job to parallel job converter!

I don't fancy your chances of getting to use these converters unless you are a PeopleSoft customer, but you could always contact Ascential support and see what they can do.

Even if you had the conversion tool you will find two things
- Quite often you will find your job needs a complete redesign given the way parallel jobs work and it is easier to rebuild it using existing documentation and the Informatica job as a guide.
- Your jobs and job control are not inherently maintainable, even if produced by a conversion tool. You still need a DataStage expert who is experienced with job control, error handling, partitioning, custom stages etc.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

If you could get your hands on the unofficial inhouse DataStage Migrator then it would take just a little bit more wheedling to also get the Server job to Parallel job Migrator! By the time you've done that double migration I wonder what quality jobs you have left...
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

Hi,
Ascential does not have any tool that can convert server jobs to parallel jobs. We spent so much money on the hardware and the EE software for our PeopleSoft EPM project, but we found out that all delivered jobs for PeopleSoft EPM are server jobs and the fastest way to convert them is to hire 15 more PX developers. Lesson learned.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Probably be more effective to get two good parallel programmers and only convert those server jobs that need to be converted. 80% of the jobs may actually run slower if converted from server to parallel jobs, or have improment gains that are negligable. Server jobs are perfectly happy to run alongside parallel jobs. And it is likely Ascential will provide a parallel set of EPM loads within the next 1 to 2 years (if Oracle don't scrap the agreement) so you can wait for them to do the work for you.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

I do agree with you about the lack of information on PeopleSoft EPM DataStage version options. At the time it came out most PeopleSoft sales staff didn't know much about DataStage, most Ascential sales staff didn't know much about the PeopleSoft version, or new about server jobs but didn't know about parallel job options. I had to do a lot of digging at the time to find the specifications of the PeopleSoft version and the platform options.
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

Well, now is IBM's sales staff trying to figure out what's server job, parallel job, PeopleSoft EPM version.... I also heard that Oracle is looking into its OWB to replace the PeopleSoft EPM DataStage. It's always small fish gets swallowed.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Oracle is in an interesting position. They bought these RDBMS independent products such as PeopleSoft but if they want to embed OWB into them they are going to have to make them Oracle dependent, which pisses off a lot of existing customers.
Post Reply