Reading data from yelp API through Datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
AmeyJoshi14
Participant
Posts: 334
Joined: Fri Dec 01, 2006 5:17 am
Location: Texas

Reading data from yelp API through Datastage

Post by AmeyJoshi14 »

Hi Experts,

We are planning to get the data from yelp website(all the comments) into our database through Datastage. I called yelp support and as per them we can use API to read the data from there website. Now my question is can we read the website through API in Datastage.
I was looking into the document and looks like we can use Web Service Client stage to read this. Could you please let me know if there is any other stage in Datastage which we can use to read the data from API?

Environment :- DS 9.1

Appreciate all your help!!

Thanks!!
http://findingjobsindatastage.blogspot.com/
Theory is when you know all and nothing works. Practice is when all works and nobody knows why. In this case we have put together theory and practice: nothing works. and nobody knows why! (Albert Einstein)
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Suggest that you look at the hierarchical stage instead, assuming that yelp supports a REST API for getting their data. You still will have to learn about the hierarchical stage, and generate or obtain a schema for the yelp payload if the send back xml (simpler if they send back JSON), but it will be vastly simpler than working with whatever SOAP based wsdl yelp might provide.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Post Reply