DSXchange

Hi ,

When I use a teraread through datastage I am getting the following error after processing some records

##I TOSH 000010 18:28:34(000) <main_program> orchgeneral: loaded
##I TOSH 000010 18:28:34(001) <main_program> orchsort: loaded
##I TOSH 000010 18:28:34(002) <main_program> orchstats: loaded
##I TFSC 000000 18:28:34(003) <main_program> APT configuration file: /apps/opt/aedw/source/config/config.apt
INFO:TCOS 18:28:35(000) <main_program> Echo:
teraread
-query 'select cust_id, cmpy_cd from bcadprd_tblsv.PWBTCDB1'
-server veritt4
-dboptions '{ user=z159203, password=z159203}'
-dbname WORK_TBLS_EXPORT >| /apps/opt/aedw/source/bcad_data/PWBTCDB1.TXT;

##W TTER 000703 18:29:14(000) <teraread> When checking operator: There will be some skew in the usage of the server b
ecause the number of players (15) is not evenly divided by the number of available nodes (8).
##W TFIG 000431 18:29:14(001) <APT_RealFileExportOperator in autoexport(0)> When checking operator: When validating e
xport schema: At field "CMPY_CD": Exporting nullable field without null handling properties
##I TTER 000741 18:30:07(000) <teraread,0> 100000 records processed
##I TTER 000741 18:30:12(000) <teraread,5> 100000 records processed
##I TTER 000741 18:30:36(000) <teraread,7> 100000 records processed
##I TTER 000741 18:30:38(000) <teraread,10> 100000 records processed
##I TTER 000741 18:30:38(000) <teraread,3> 100000 records processed
##I TTER 000741 18:30:42(000) <teraread,9> 100000 records processed
##I TTER 000741 18:30:43(000) <teraread,4> 100000 records processed
##I TTER 000741 18:30:44(000) <teraread,12> 100000 records processed
##I TTER 000741 18:30:45(000) <teraread,0> 200000 records processed
##I TTER 000741 18:30:52(000) <teraread,6> 100000 records processed
##I TTER 000741 18:30:54(000) <teraread,7> 200000 records processed
##I TTER 000741 18:31:01(000) <teraread,9> 200000 records processed
##I TTER 000741 18:31:03(000) <teraread,10> 200000 records processed
##I TTER 000741 18:31:05(000) <teraread,12> 200000 records processed
##I TTER 000741 18:31:07(000) <teraread,0> 300000 records processed
##I TTER 000741 18:31:09(000) <teraread,3> 200000 records processed
##I TTER 000741 18:31:12(000) <teraread,6> 200000 records processed
##I TTER 000741 18:31:21(000) <teraread,9> 300000 records processed
##I TTER 000741 18:31:22(000) <teraread,7> 300000 records processed
##I TTER 000741 18:31:24(000) <teraread,12> 300000 records processed
##I TTER 000741 18:31:26(000) <teraread,4> 200000 records processed
##I TTER 000741 18:31:26(000) <teraread,10> 300000 records processed
##I TTER 000741 18:31:43(000) <teraread,0> 400000 records processed
##I TTER 000741 18:31:59(000) <teraread,8> 100000 records processed
##I TTER 000741 18:32:01(000) <teraread,3> 300000 records processed
##I TTER 000741 18:32:02(000) <teraread,9> 400000 records processed
##I TTER 000741 18:32:05(000) <teraread,7> 400000 records processed
##I TTER 000741 18:32:06(000) <teraread,6> 300000 records processed
##I TTER 000741 18:32:07(000) <teraread,10> 400000 records processed
##I TTER 000742 18:32:07(000) <teraread,0> 439678 total records processed.
##I TTER 000742 18:32:09(000) <teraread,9> 440180 total records processed.
##I TTER 000741 18:32:10(000) <teraread,12> 400000 records processed
##I TTER 000742 18:32:12(000) <teraread,7> 440235 total records processed.
##I TTER 000742 18:32:18(000) <teraread,10> 440275 total records processed.
##I TTER 000742 18:32:19(000) <teraread,12> 439515 total records processed.
##I TTER 000741 18:32:20(000) <teraread,8> 200000 records processed
##I TTER 000741 18:32:23(000) <teraread,6> 400000 records processed
##I TTER 000742 18:32:29(000) <teraread,6> 439728 total records processed.
##I TTER 000741 18:32:30(000) <teraread,4> 300000 records processed
##I TTER 000741 18:32:32(000) <teraread,3> 400000 records processed
##I TTER 000741 18:32:40(000) <teraread,8> 300000 records processed
##I TTER 000742 18:32:41(000) <teraread,3> 439639 total records processed.
##I TTER 000741 18:33:21(000) <teraread,8> 400000 records processed
##I TTER 000742 18:33:26(000) <teraread,8> 440223 total records processed.
##I TTER 000741 18:33:30(000) <teraread,4> 400000 records processed
##I TTER 000742 18:33:39(000) <teraread,4> 439635 total records processed.
##E TTER 000620 18:34:56(000) <teraread,13> APT_TeraUtils: Slave session CLI Error:: 'Fetch failed: Error Code = 220
', error code = 1 message: 'Fetch failed: Error Code = 220'
DBCAREA msg_txt: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

##E TFOR 000146 18:34:56(001) <teraread,13> Failure during execution of operator logic
##I TFOR 000143 18:34:56(002) <teraread,13> Output 0 produced 24300 records
##F TUXX 000002 18:34:56(003) <teraread,13> Internal Error: (0): terasession.C cliGetRespParcel: fetch failure
Traceback: (gdb) Detaching from program: /apps/opt/ascential/apt/bin/osh, process 4545

##E TFPM 020092 18:34:56(000) <node_dreamG5> Player 2 terminated unexpectedly.
##E TFPM 020192 18:34:56(000) <teraread,6> Unexpected exit status 1
##E TFOR 000146 18:34:56(000) <APT_RealFileExportOperator in autoexport(0),0> Failure during execution of operator lo
gic
##I TFOR 000142 18:34:56(001) <APT_RealFileExportOperator in autoexport(0),0> Input 0 consumed 4293872 records
##F TFIO 030045 18:34:56(002) <APT_RealFileExportOperator in autoexport(0),0> waitForWriteSignal(): Premature EOF on
node ewttlt01 No such file or directory
##E TFPM 020192 18:34:56(001) <APT_RealFileExportOperator in autoexport(0)> Unexpected exit status 1
##E TFSR 000002 18:35:01(000) <main_program> Step execution finished with status = FAILED.
INFO:TCOS 18:35:01(000) <main_program> Schemas:
Data set "teraread[o0].v":
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)
Operator "teraread":
output 0 interface:
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)
Operator "{natural="/apps/opt/aedw/source/bcad_data/PWBTCDB1.TXT", synthetic="autoexport(0)"}":
input 0 interface:
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)

INFO:TCOS 18:35:01(001) <main_program> Startup Time 0:49 Production Run Time 5:38


please help me

thanks

ram

Isolate the actual error messages. What do these tell you?

APT_TeraUtils: Slave session CLI Error:: 'Fetch failed: Error Code = 220', error code = 1 message: 'Fetch failed: Error Code = 220'
DBCAREA msg_txt: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

(The next piece reports the fetch failure on node 13. This almost certainly results from losing the connection.)

Premature EOF on node ewttlt01 No such file or directory

(This may be a consequent error, or may be a separate error. Without your configuration file I cannot tell if node ewttl01 is node number 13.)

It is recommended to run PX on an even number of nodes. If you set the config to be 14-way or 16-way, do you still get the same problem?

-BP

We have got the EE job failed with the same issue :

ExtPATY_ACCTFrmGDW..AcctIFound: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

BTW, we have 4 nodes in the configuration file.

Any advice ?

Thanks

bigpoppa wrote:It is recommended to run PX on an even number of nodes. If you set the config to be 14-way or 16-way, do you still get the same problem?

-BP

Get a more reliable network.

In other words, talk to your SAs and/or Network guys.