Page 1 of 1

Reading data from yelp API through Datastage

Posted: Tue Sep 22, 2015 9:04 am
by AmeyJoshi14
Hi Experts,

We are planning to get the data from yelp website(all the comments) into our database through Datastage. I called yelp support and as per them we can use API to read the data from there website. Now my question is can we read the website through API in Datastage.
I was looking into the document and looks like we can use Web Service Client stage to read this. Could you please let me know if there is any other stage in Datastage which we can use to read the data from API?

Environment :- DS 9.1

Appreciate all your help!!

Thanks!!

Posted: Tue Sep 22, 2015 11:06 am
by eostic
Suggest that you look at the hierarchical stage instead, assuming that yelp supports a REST API for getting their data. You still will have to learn about the hierarchical stage, and generate or obtain a schema for the yelp payload if the send back xml (simpler if they send back JSON), but it will be vastly simpler than working with whatever SOAP based wsdl yelp might provide.

Ernie