Pulling Data from API URL

cyclogenisis · Post by **cyclogenisis** » Fri Nov 20, 2015 3:58 pm

Hi All,

Hoping someone may be able to assist me. I'm trying to determine whether Datastage has a straight forward way of pulling data from an API URL. For example, Coremetrics/IBM Data Analytics has reports you can put in place which you can access data by using an API URL. Is it possible to pull this data from API directly into Datastage with defining structure?

eostic · Post by **eostic** » Sun Nov 22, 2015 6:34 pm

If that "API" uses REST protocol, and returning xml or json, then, yes.....you should be able to use the hierarchical Stage, which supports REST based web services.

Ernie

cyclogenisis · Post by **cyclogenisis** » Fri Dec 04, 2015 3:45 pm

Hi actually using DS 9.1 which doesn't have this stage. Is there a way in v9.1?

cyclogenisis · Post by **cyclogenisis** » Wed Dec 09, 2015 11:03 pm

In case anyone at some point views this thread for an answer. I ended up using the curl shell command to pull data and save it to disk. Then process the file from there since the stage in question is not available in 9.1.