DataStage Roadmap Information

jared5494 · Post by **jared5494** » Mon Dec 31, 2007 9:03 am

Hello,
This is more of a general question: Where can I find DataStage roadmap information? I have tried emailing IBM, but haven't received a response and the web hasn't been much help. I am trying to get information such as future release information, when they will stop support of legacy versions, and any additional future release information.

Thanks in advance,
Jared

shawn_ramsey · Post by **shawn_ramsey** » Mon Dec 31, 2007 3:19 pm

jared5494 wrote:Hello,
This is more of a general question: Where can I find DataStage roadmap information? I have tried emailing IBM, but haven't received a response and the web hasn't been much help. I am trying to get information such as future release information, when they will stop support of legacy versions, and any additional future release information.

Thanks in advance,
Jared

Contact your sales team. Ours has always been able to give us these types of updates.

vmcburney · Post by **vmcburney** » Mon Apr 27, 2009 8:22 pm

You can write your own de-identification functions. For example if you are trying to replace names with junk data you can use the Row Generator. If you want to encrypt data you need third party encryption software. If you have a hashing algorithm you can apply it in DataStage via an external java or c++ routine. IBM Global Resources have written some de-identification for DataStage but I don't think they share them, though one day we might see them in the standard install. There are also advanced functions if you use IBM Optim.

More info in my blog posts:
IBM Information Server and DataStage Roadmap for 2008 and 2009
IBM Ends Support for DataStage 3, 4 and 5

chulett · Post by **chulett** » Mon Apr 27, 2009 10:39 pm

This is the data "masking" they've talked about at IOD, yes? If so, I understood that it is as you said, only if you engage them will they allow access to the functions they have written. Did seem very nice, though.

And I do think they may have echoed the 'someday' comment.

bpsprecher · Post by **bpsprecher** » Tue Apr 28, 2009 12:49 pm

Thank you gentlemen for your time -- I used your information as ammunition in my PMR. We'll see what they say now.

We've been writing de-identification code with Row Generators & Transformers, and our next step is external C++ routines. However, if IBM already has something available (now, or soon) we'd sure like to take advantage of tested code.

ray.wurlod · Post by **ray.wurlod** » Tue Apr 28, 2009 4:09 pm

The do have it, it was shown at IOD 2008. Whether it's "available" is a different question. If your support provider can't find any information (after being leaned upon in a suitable fashion) please post back here, so some of the IBMers who are involved can be alerted (and maybe even post a response).

bpsprecher · Post by **bpsprecher** » Wed Apr 29, 2009 9:22 am

Sufficient pressure has been applied to our Sales Rep, our Technical Specialist, and the engineer working on the PMR. Now awaiting responses...

bpsprecher · Post by **bpsprecher** » Tue Jun 23, 2009 9:26 am

I met with our Sales Rep and Software Architect and asked if the de-identification features mentioned in the IOD Conference were related to the Optim products. They didn't believe so, but I got this information from the engineer assigned to my PMR:

Is IBM Optim a tool, environment, consulting services, methodology, etc.? Optim is a set of software that IBM acquired from a company known as Princeton Softtech. Basically they do archiving of production data that is no longer needed online (data lifecycle management) and securing of test data (obscuring information that cannot leave your organization).

What is this "data masking" feature? Is it worth waiting for, or should we pursue our custom functions & routines? About 2 years ago Mike Carney was doing a lot of work in this space developing home grown masking software.
This was then superceeded when we acquired Princeton. I believe any integration is being handled via Consulting.

Is it billable? The Optim products themselves are Sellable. I think for our data masking integration we have access to their libraries for ACG reuse, so that would be billable.

It seems as though the data de-identification features will no longer be offered in an upcoming DataStage release. This is now an outstanding question to my Sales Rep & Software Architect, so I will update this post with any additional information.

bpsprecher · Post by **bpsprecher** » Tue Jun 23, 2009 3:38 pm

Our Sales Engineer just provided me with this information:

"A new add-on product for managing data privacy/deidentification within Information Server is on the roadmap based on DataStage v8.5 release. It will be based on Optim data masking technology. No firm date is yet planned - rough estimate for release of the new Privacy Pack is 1H of 2010.

The Pack will consist of an active transformer like stage with a set of standard and user configurable deidentification transformation types."

vmcburney · Post by **vmcburney** » Tue Jun 23, 2009 8:58 pm

Optim is already integrated with InfoSphere Data Architect so you can apply security and masking requirements at the data model level. I am guessing in Information Server 8.5 I the Data Architect will be better integrated with FastTrack and DataStage so the data masking can be applied straight into DataStage from imported table definitions.

I posted some updated DataStage Roadmap info on my blog but it looks like IBM have pulled the presentation it came from (EMEA 2009 downloads). See IBM Loosens Up with IOD 2009 Presentations for Everyone and IBM to Enhance the DataStage Transformer Stage.

chulett · Post by **chulett** » Wed Jun 24, 2009 6:33 am

Nice. The changes coming to the venerable Transformer stage are pretty

DSXchange

DataStage Roadmap Information

DataStage Roadmap Information

Re: DataStage Roadmap Information