DSXchange

Hi everyone,

has anyone tried to automate builds of deployment packages via popular build tools like Ant, Gradle or Maven?

We use Gradle + Jenkins for CI builds in Java. I want to use this infrastructure as much as possible to build Datastage deployment packages automatically.

Thanks for any suggestions.

Rgds.

Juergen

We've automated the build process using Atlassian Bamboo (a build automation tool similar to Jenkins or Hudson) which extracts the currently open DataStage job from XMETA, invokes a set of unit tests, then checks the job into Stash (Atlassian's wrapped version of Git). The unit tests involve loading the DataStage job's OSH into a graph database and testing for anti-patterns, such as adjacent transformers, or anything else we want to identify. Some lead to warnings, some lead to the check-in being rejected. Bamboo can additionally update the job's long description with version/deployment information.

Jobs are then automatically deployed to an integration test environment (again using Bamboo) where they are tested against restricted data volumes with functional test cases. When all tests are passed the job becomes a candidate for promotion to production, or other test environments as necessary.

This process means all developers work in the same project, and we have good control over, and transparency of, our code releases.

John

Thanks for your answer John.

How do you get the open jobs from XMETA? Plain SQL queries? Which tables? In which format, is it an isx-formatted export?
How do you deploy the jobs? Do you use istool? Is there an API available for build/deployment?

Thanks again.

Juergen

Those following this thread might be interested to know that my organisation's solution for implementing DevOps approaches with DataStage development (called 'MettleCI') has now been announced on the Atlassian Marketplace:

https://marketplace.atlassian.com/plugi ... .mettleci/

You can find out more here: https://www.mettleci.com