Anyone else with Netezza and DataStage?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Aruna Gutti
Premium Member
Premium Member
Posts: 145
Joined: Fri Sep 21, 2007 9:35 am
Location: Boston

Post by Aruna Gutti »

Hi Shawn,

did you ever started the Netezza Network with people who are using Netezza with DataStage ?

We are using Netezza as a target for our Datawarehouse project using Information server version 8.0.1. I could not get Netezza Enterprise Stage to work at all, either with 'Nzload' option or 'ET' option.

I could successfully load using ODBC enterprise Stage using the same input data.

If you encountered this kind of problems in version 7.5.2 could you please help me resolve this ?

Many Thanks,

Aruna.

-------------------------------------------------------------------------------------
These are the Errors I found in pg.log in Netezza Server.

1) Case 1 : I am getting the following Error when I tried to use Netezza stage to load data directly from a DataSet. Please observe the error 'Attribute 'ds1sc' not found'. This the the exact error I am getting when I am trying to run Nzload from DataStage Server directly.

2007-12-19 09:46:25.903291 EST [32148] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:46:25.963085 EST [32148] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:46:25.963845 EST [32148] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:46:25.964605 EST [32148] DEBUG: QUERY: select version()
2007-12-19 09:46:25.966078 EST [32148] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:46:26.796217 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:46:26.797195 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:46:26.800928 EST [32149] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:46:26.806530 EST [32150] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:46:26.881484 EST [32149] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:46:26.882518 EST [32149] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:46:26.883321 EST [32149] DEBUG: QUERY: select version()
2007-12-19 09:46:26.884950 EST [32149] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:46:26.900166 EST [32150] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:46:26.900932 EST [32150] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:46:26.901692 EST [32150] DEBUG: QUERY: select version()
2007-12-19 09:46:26.901921 EST [32149] DEBUG: QUERY: SELECT VAL FROM _V_ENVIRON WHERE NAME = 'NZ_LOG_DIR'
2007-12-19 09:46:26.902259 EST [32149] ERROR: Relation '_v_environ' does not exist
2007-12-19 09:46:26.903569 EST [32150] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:46:26.907560 EST [32149] DEBUG: QUERY: SELECT VAL FROM _T_ENVIRON WHERE NAME = 'NZ_LOG_DIR'
2007-12-19 09:46:26.918043 EST [32149] ERROR: Permission denied on "_t_environ".
2007-12-19 09:46:26.923412 EST [32149] DEBUG: QUERY: SELECT DATABASE FROM _V_DATABASE WHERE DATABASE = ^ds1sc^
2007-12-19 09:46:26.924654 EST [32149] ERROR: Attribute 'ds1sc' not found
2007-12-19 09:46:26.929680 EST [32150] DEBUG: QUERY: SELECT VAL FROM _V_ENVIRON WHERE NAME = 'NZ_LOG_DIR'
2007-12-19 09:46:26.929856 EST [32149] DEBUG: QueryCancelHandler() with ImmediateInterruptOK=0, InterruptHoldoffCount=0, CritSectionCount=0, proc_exit_inprogress=0
2007-12-19 09:46:26.930012 EST [32150] ERROR: Relation '_v_environ' does not exist
2007-12-19 09:46:26.930026 EST [32149] ERROR: Query was cancelled.
2007-12-19 09:46:26.937075 EST [32149] FATAL 1: [32149] pq_flush: send() failed: Connection reset by peer
2007-12-19 09:46:26.939991 EST [32150] DEBUG: QUERY: SELECT VAL FROM _T_ENVIRON WHERE NAME = 'NZ_LOG_DIR'
2007-12-19 09:46:26.948973 EST [32150] ERROR: Permission denied on "_t_environ".
2007-12-19 09:46:26.954345 EST [32150] DEBUG: QUERY: SELECT DATABASE FROM _V_DATABASE WHERE DATABASE = ^ds1sc^
2007-12-19 09:46:26.955561 EST [32150] ERROR: Attribute 'ds1sc' not found
2007-12-19 09:46:26.960001 EST [32150] DEBUG: QueryCancelHandler() with ImmediateInterruptOK=0, InterruptHoldoffCount=0, CritSectionCount=0, proc_exit_inprogress=0
2007-12-19 09:46:26.960238 EST [32150] ERROR: Query was cancelled.
2007-12-19 09:46:26.965165 EST [32150] FATAL 1: [32150] pq_flush: send() failed: Connection reset by peer
2007-12-19 09:46:33.029618 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:46:33.034015 EST [32151] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc


Case 2: When I am trying to load data from a transformer stage using ET option in Netezza Stage, I am getting the following errors.

2007-12-19 09:21:00.365235 EST [31951] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:21:00.366124 EST [31951] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:21:00.366709 EST [31951] DEBUG: QUERY: select version()
2007-12-19 09:21:00.368637 EST [31951] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:21:00.382018 EST [31952] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:21:00.382833 EST [31952] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:21:00.383420 EST [31952] DEBUG: QUERY: select version()
2007-12-19 09:21:00.387056 EST [31952] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:21:00.388392 EST [31951] DEBUG: QUERY: drop table NZORCH_20071219151220986_0
2007-12-19 09:21:00.390600 EST [31951] ERROR: pg_aclcheck: object "nzorch_20071219151220986_0" not found
2007-12-19 09:21:00.400286 EST [31951] DEBUG: QUERY: CREATE EXTERNAL TABLE NZORCH_20071219151220986_0 SAMEAS ds1sc.admin.tn1od_reports USING (DATAOBJECT ('/tmp/lnxqapp601_1956.0') remotesource 'odbc' delimiter '@' logDir '/DataStage/scratch' boolStyle 'T_F' encoding 'internal'nullValue 'NULL' maxErrors 1)
2007-12-19 09:21:00.409631 EST [31952] DEBUG: QUERY: drop table NZORCH_20071219151220984_1
2007-12-19 09:21:00.410753 EST [31952] ERROR: pg_aclcheck: object "nzorch_20071219151220984_1" not found
2007-12-19 09:21:00.419058 EST [31951] DEBUG: QUERY: INSERT INTO ds1sc.admin.tn1od_reports SELECT * FROM NZORCH_20071219151220986_0
2007-12-19 09:21:00.419279 EST [31952] DEBUG: QUERY: CREATE EXTERNAL TABLE NZORCH_20071219151220984_1 SAMEAS ds1sc.admin.tn1od_reports USING (DATAOBJECT ('/tmp/lnxqapp601_1956.1') remotesource 'odbc' delimiter '@' logDir '/DataStage/scratch' boolStyle 'T_F' encoding 'internal'nullValue 'NULL' maxErrors 1)
2007-12-19 09:21:00.434709 EST [31952] DEBUG: QUERY: INSERT INTO ds1sc.admin.tn1od_reports SELECT * FROM NZORCH_20071219151220984_1
2007-12-19 09:21:03.475683 EST [31952] DEBUG: -- recursive call to NdeReapRdrProcesses: returning
2007-12-19 09:21:03.475684 EST [31951] DEBUG: -- recursive call to NdeReapRdrProcesses: returning
2007-12-19 09:21:03.475771 EST [31952] DEBUG: ldrFileRdr terminated normally
2007-12-19 09:21:03.475789 EST [31951] DEBUG: ldrFileRdr terminated normally
2007-12-19 09:21:03.475834 EST [31952] ERROR: unable to open '/DataStage/scratch/nzorch_20071219151220984_1.ds1sc.nzlog' - No such file or directo
2007-12-19 09:21:03.475838 EST [31951] ERROR: unable to open '/DataStage/scratch/nzorch_20071219151220986_0.ds1sc.nzlog' - No such file or directo
2007-12-19 09:21:03.550213 EST [31952] FATAL 1: Socket command type
2007-12-19 09:21:03.556790 EST [31951] FATAL 1: Socket command type
2007-12-19 09:21:09.620914 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:21:09.625395 EST [31957] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:21:09.685040 EST [31957] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:21:09.685805 EST [31957] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:21:09.686545 EST [31957] DEBUG: QUERY: select version()
2007-12-19 09:21:09.688200 EST [31957] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:21:09.726623 EST [31948] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:21:09.726685 EST [31950] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:21:09.730260 EST [31957] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:41:12.821015 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:41:12.825514 EST [32131] DEBUG: connection: host=172.24.68.120 user=dspocu database=ds1sc

Case 3: When I am trying to load from a transformer Stage to Netezza using nzload option I am just getting this error.

2007-12-19 09:46:24.442873 EST [32146] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:46:24.443682 EST [32146] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:46:24.444405 EST [32146] DEBUG: QUERY: select version()
2007-12-19 09:46:24.446588 EST [32146] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:46:24.460051 EST [32146] DEBUG: QUERY: select * from ds1sc.admin.tn1od_reports LIMIT 10
2007-12-19 09:46:24.519212 EST [32146] DEBUG: QUERY: SELECT * FROM ds1sc.admin.tn1od_reports LIMIT 0
2007-12-19 09:46:24.533028 EST [32146] DEBUG: QUERY: truncate table ds1sc.admin.tn1od_reports
2007-12-19 09:46:25.673263 EST [32146] DEBUG: InsertEmptyTableDummyStats called on table 'tn1od_reports'
2007-12-19 09:46:25.743490 EST [32146] DEBUG: QUERY: select owner from _v_table where tablename='ds1sc.admin.tn1od_reports'
2007-12-19 09:46:25.879051 EST [32146] DEBUG: QUERY: select * from MetaStage_Loc_Info LIMIT 10
2007-12-19 09:46:25.879442 EST [32146] ERROR: Relation 'metastage_loc_info' does not exist
2007-12-19 09:46:25.898938 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
2007-12-19 09:46:33.093626 EST [32151] DEBUG: QUERY: set nz_encoding to 'utf8'
2007-12-19 09:46:33.094403 EST [32151] DEBUG: QUERY: set DateStyle to 'ISO'
2007-12-19 09:46:33.095137 EST [32151] DEBUG: QUERY: select version()
2007-12-19 09:46:33.096751 EST [32151] DEBUG: QUERY: select feature from _v_odbc_feature where spec_level = '3.5'
2007-12-19 09:46:33.131598 EST [32146] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:46:33.131670 EST [32148] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:46:33.132769 EST [32151] DEBUG: disconnect: host=172.24.68.120 user=dspocu database=ds1sc
2007-12-19 09:47:32.849665 EST [26890] DEBUG: connection failed: host=172.24.68.120 user= database=
Top
OYILMAZ
Participant
Posts: 8
Joined: Tue Nov 30, 2010 4:30 am
Location: Istanbul

Post by OYILMAZ »

Hi Aruna,

Could you handle this problem? You had asked it 3 years ago but maybe i can find my solution.

Thanks a lot.
Oguz YILMAZ
Information Management Consultant
Istanbul, Turkey
Top
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Please start a new post and give us the details of your problem.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Top
OYILMAZ
Participant
Posts: 8
Joined: Tue Nov 30, 2010 4:30 am
Location: Istanbul

Post by OYILMAZ »

Thanks for guiding.

its here,

viewtopic.php?t=140082
Oguz YILMAZ
Information Management Consultant
Istanbul, Turkey
Top
Post Reply

Return to “IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)”