How to load a file from a URL using DataStage
Moderators: chulett, rschirm, roy
How to load a file from a URL using DataStage
Hello friends,
As per my requirement I need to read a file(say file1 as also depicted below in the url) which would be posted on a URL.
The URL is somewha like:
http://abc.com/group/files/file1
I need to use DataStage Jobs to do this.
Kindly advise and let me know if I need to give further details.
Thanks in Advance!!
As per my requirement I need to read a file(say file1 as also depicted below in the url) which would be posted on a URL.
The URL is somewha like:
http://abc.com/group/files/file1
I need to use DataStage Jobs to do this.
Kindly advise and let me know if I need to give further details.
Thanks in Advance!!
For some reason I was thinking 'XML' when answering you, so what I meant was the XML Input stage... however, the FTP stage should be the correct answer here though personally I've never tried sourcing from a URL with it. Give it a shot, let us know.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
The problem is the web url: http://abc.com/group/files/file1
is not a FTP server but an HTTP one and hence we donot have a username/password to access it. Its like an intranet url where files are posted and is hosted on an apache server and you can download files from there.
This is the reason I am unable to use an FTP stage to access the files.
Please help!! Thanks in Advance
is not a FTP server but an HTTP one and hence we donot have a username/password to access it. Its like an intranet url where files are posted and is hosted on an apache server and you can download files from there.
This is the reason I am unable to use an FTP stage to access the files.
Please help!! Thanks in Advance
I've seen it done with JavaPack and long ago with the old Perl Stage.
Today, write a java class that can get the document via HTTP and then you can parse it as appropriate and send the rows down an output link.
Ernie
Today, write a java class that can get the document via HTTP and then you can parse it as appropriate and send the rows down an output link.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Ah yes....it was a fun time in the early web-bubble days. The sessionizer was the most interesting.......thought it was going to make a comeback, but alas, not enough demand...into the bin with other cool stuff from the past like the Job Edit API.... ; )
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
JavaPack is there....we don't call it "JavaPack" so much anymore because it is no longer a chargeable item. Look for the Java Transformer and Java Client Stages in your palette... Doc is in lots of places also, and with lots of entries here in this forum, and I have some samples at my blog noted below.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>