Connection to AWS S3 refused.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
altis
Premium Member
Premium Member
Posts: 11
Joined: Thu Mar 29, 2007 1:38 am

Connection to AWS S3 refused.

Post by altis »

Hi,

I am trying to connect to AWS S3 from DataStage.
I am using the S3 connector provided by DataStage to read/write from/to AWS S3.

I am getting the following error when running the job:
Unable to execute HTTP request: Connection to https://<bucket-name>.s3.amazonaws.com refused

I am able to read/write to S3 using the AWS CLI installed on the same server DataStage is installed on. This means that the server can connect to S3, but DataStage can't.

The server is using a Proxy to connect to internet.
Proxy settings have been applied to all users, but I'm not sure DataStage is using these Proxy settings to connect to the S3.

How can I make sure that DataStage uses the proxy settings defined for all users?

Cheers

G
Altis Consulting Pty Ltd
www.altis.com.au
altis
Premium Member
Premium Member
Posts: 11
Joined: Thu Mar 29, 2007 1:38 am

Post by altis »

Hi,

We have identified that this is due to DataStage not picking up the global Proxy Settings.
The service user running DataStage is able to pick up the Proxy setting when outside of DataStage (we tested it outside of DataStage), but not when running DataStage.

Any idea of what could be causing this?

Thanks a lot.
Altis Consulting Pty Ltd
www.altis.com.au
Post Reply