Oracle write hangs infinitely

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Oracle write hangs infinitely

Post by vasa_dxx »

Starting Job test_1.

Environment variable settings:
ALLUSERSPROFILE=C:\Documents and Settings\All Users
APT_AUTO_TRANSPORT_BLOCK_SIZE=1
APT_CONFIG_FILE=D:\Ascential\DataStage\Configurations\default.apt
APT_DUMP_SCORE=1
APT_OPERATOR_REGISTRY_PATH=D:\Ascential\DataStage\Projects\development\buildop;%APT_OPERATOR_REGISTRY_PATH%
APT_ORCHHOME=D:/Ascential/DataStage/PXEngine
APT_PM_NODE_TIMEOUT=3
APT_PM_NO_NAMED_PIPES=1
APT_PM_PLAYER_MEMORY=1
APT_PM_PLAYER_TIMING=1
APT_RECORD_COUNTS=1
APT_STARTUP_STATUS=1
BELL=^G
CommonProgramFiles=C:\Program Files\Common Files
COMPUTERNAME=IBMLENOVO
ComSpec=C:\WINDOWS\system32\cmd.exe
DISPLAY=:0.0
DSIPC_OPEN_TIMEOUT=30
DSPackagePath=D:\Ascential\DataStage\Package
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
FLAVOR=-1
FP_NO_HOST_CHECK=NO
MAN_CHM_INDEX=C:/PROGRA~1/MKSTOO~1/mksnt/tkutil.idx;C:/PROGRA~1/MKSTOO~1/mksnt/tkapi.idx;C:/PROGRA~1/MKSTOO~1/mksnt/tcltk.idx;C:/PROGRA~1/MKSTOO~1/mksnt/tkperl.idx
MAN_TXT_INDEX=C:/PROGRA~1/MKSTOO~1/etc/tkutil.idx;C:/PROGRA~1/MKSTOO~1/etc/tkapi.idx;C:/PROGRA~1/MKSTOO~1/etc/tcltk.idx;C:/PROGRA~1/MKSTOO~1/etc/tkperl.idx
NUMBER_OF_PROCESSORS=2
NUTCROOT=C:\PROGRA~1\MKSTOO~1
OS=Windows_NT
OSH_DUMP=1
OSH_EXPLAIN=1
PATH=D:\Ascential\DataStage\Projects\development\RT_BP1.O;D:\Ascential\DataStage\Engine\bin;D:\Ascential\DataStage\PXEngine\bin;D:\Ascential\DataStage\Projects\development\wrapped;D:\Ascential\DataStage\Projects\development\buildop;D:\Ascential\DataStage\DSCAPIOp;D:\Ascential\DataStage\RTIOperators;D:\Ascential\DataStage\DSParallel;D:\Ascential\DataStage\PXEngine\user_osh_wrappers;D:\Ascential\DataStage\PXEngine\osh_wrappers;D:\Ascential\DataStage\PXEnginein;C:\PROGRA~1\MKSTOO~1\bin;C:\PROGRA~1\MKSTOO~1\bin\X11;C:\PROGRA~1\MKSTOO~1\mksnt;E:\oracle\product\10.2.0\db_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Ascential\ODBCdrivers;C:\Program Files\Common Files\Teleca Shared
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.sh;.ksh;.csh;.sed;.awk;.pl
PERL5LIB=E:\oracle\product\10.2.0\db_1\perl\5.8.3\lib\MSWin32-x86;E:\oracle\product\10.2.0\db_1\perl\5.8.3\lib;E:\oracle\product\10.2.0\db_1\perl\5.8.3\lib\MSWin32-x86;E:\oracle\product\10.2.0\db_1\perl\site\5.8.3;E:\oracle\product\10.2.0\db_1\perl\site\5.8.3\lib;E:\oracle\product\10.2.0\db_1\sysman\admin\scripts;
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_IDENTIFIER=x86 Family 6 Model 14 Stepping 12, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=0e0c
ProgramFiles=C:\Program Files
PWD=D:\Ascential\DataStage\Projects\development
ROOTDIR=C:/PROGRA~1/MKSTOO~1
SHELL=C:/PROGRA~1/MKSTOO~1/mksnt/sh.exe
SystemDrive=C:
SystemRoot=C:\WINDOWS
TEMP=C:\WINDOWS\TEMP
TERMCAP=C:\PROGRA~1\MKSTOO~1\etc\termcap
TERMINFO=C:\PROGRA~1\MKSTOO~1\usr\lib\terminfo
TMP=C:\WINDOWS\TEMP
TMPDIR=D:\TMP
UNIVERSE_CONTROLLING_TERM=1
UNIVERSE_PARENT_PROCESS=2944
USER=IBMLENOVO\IBMLenovo
USERPROFILE=C:\Documents and Settings\LocalService
WHO=development
windir=C:\WINDOWS
TERM=console
DS_USERNO=-1976
OSH_STDOUT_MSG=1
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message

Parallel job initiated
# OSH / orchestrate script for Job test_1 compiled at 00:48:51 04 OCT 2008
#################################################################
#### STAGE: EM123
## Operator
orawrite
## Operator options
-dboptions '{user=scott,password=[&__V0S1P2_password]}'
-table 'em123'
-mode replace
-server 'orcl'

## General options
[ident('EM123'); jobmon_ident('EM123')]
## Inputs
0< 'ADC:DSLink5.v'
;

#################################################################
#### STAGE: ADC
## Operator
oraread
## Operator options
-dboptions '{user=scott,password=[&__V0S4P2_password]}'
-table 'ADC'
-server 'ORCL'

## General options
[ident('ADC'); jobmon_ident('ADC')]
## Outputs
0> [modify (
NUMB:nullable decimal[38,10]=NUMB;
MGR:nullable string[38]=MGR;
)] 'ADC:DSLink5.v'
;


# End of OSH code

main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded


main_program: Explanation:
Step has 2 operators.
???, invoked with args: -dboptions {user=scott,password=tiger} -table em123 -mode replace -server orcl
input port 0 bound to data entity "ADC:DSLink5.v"
???, invoked with args: -dboptions {user=scott,password=tiger} -table ADC -server ORCL
output port 0 bound to data entity "ADC:DSLink5.v"
Step has 1 data entity.
Data "ADC:DSLink5.v"(an Orchestrate data set)
written by operator "ADC"
read by operator "EM123"

main_program: Dump:
{
text="orawrite\r\n-dboptions '{user=scott,password=tiger}'\r\n-table 'em123'\r\n-mode replace\r\n-server 'orcl'\r\n\r\n[ident('EM123'); jobmon_ident('EM123')]\r\n0< 'ADC:DSLink5.v'\r\n;\r\n\r\noraread\r\n-dboptions '{user=scott,password=tiger}'\r\n-table 'ADC'\r\n-server 'ORCL'\r\n\r\n[ident('ADC'); jobmon_ident('ADC')]\r\n0> [modify(NUMB:nullable decimal[38,10]=NUMB;MGR:nullable string[38]=MGR;)] 'ADC:DSLink5.v'\r\n;",
line=1, column=1, name="", qualname="",
op={
text="orawrite\r\n-dboptions '{user=scott,password=tiger}'\r\n-table 'em123'\r\n-mode replace\r\n-server 'orcl'\r\n\r\n[ident('EM123'); jobmon_ident('EM123')]\r\n0< 'ADC:DSLink5.v'",
line=1, column=1, name=orawrite, qualname=EM123,
wrapout={},
wrapperfile=orawrite, kind=non_wrapper_cdi_op, exec_mode=none,
args="'{user=scott,password=tiger}'-table'em123'-mode'replace'-server'orcl'",
input={ text="\r\n0< 'ADC:DSLink5.v'", line=8, column=1, name="",
qualname="EM123[i0]", data="ADC:DSLink5.v"
}
},
op={
text="\r\n\r\noraread\r\n-dboptions '{user=scott,password=tiger}'\r\n-table 'ADC'\r\n-server 'ORCL'\r\n\r\n[ident('ADC'); jobmon_ident('ADC')]\r\n0> [modify(NUMB:nullable decimal[38,10]=NUMB;MGR:nullable string[38]=MGR;)] 'ADC:DSLink5.v'",
line=11, column=1, name=oraread, qualname=ADC,
wrapout={},
wrapperfile=oraread, kind=non_wrapper_cdi_op, exec_mode=none,
args="'{user=scott,password=tiger}'-table'ADC'-server'ORCL'",
output={
text="\r\n0> [modify(NUMB:nullable decimal[38,10]=NUMB;MGR:nullable string[38]=MGR;)] 'ADC:DSLink5.v'",
line=17, column=1, name="", qualname="ADC[o0]",
data="ADC:DSLink5.v",
outadapt="NUMB:nullable decimal[38,10]=NUMB;MGR:nullable string[38]=MGR;"
}
},
data={ text="\r\n0< 'ADC:DSLink5.v'", line=8, column=1,
name="ADC:DSLink5.v", qualname="ADC:DSLink5.v",
partwrapout={},
collwrapout={},
dir=flow, kind=ds, inrefcount=1, writer=ADC, reader=EM123, pp=none,
trunc=default, ident="ADC:DSLink5.v"
}
}
ADC: Column NUMB floating point decimal not fully supported. Adjusting scale.

main_program: APT configuration file: D:/Ascential/DataStage/Configurations/default.apt
{
node "node1"
{
fastname "IBMLENOVO"
pools ""
resource disk "D:/Ascential/DataStage/Datasets" { pools "" }
resource scratchdisk "D:/Ascential/DataStage/Scratch" { pools "" }
}

main_program: This step has 2 datasets:
ds0: {op0[1p] (sequential ADC)
->eCollectAny
op1[1p] (sequential APT_DBExportOperator in EM123)}
ds1: {op1[1p] (sequential APT_DBExportOperator in EM123)
eAny->eCollectAny
op2[1p] (parallel APT_OraWriteSubOperator in EM123)}
It has 3 operators:
op0[1p] {(sequential ADC)
on nodes (
node1[op0,p0]
)}
op1[1p] {(sequential APT_DBExportOperator in EM123)
on nodes (
node1[op1,p0]
)}
op2[1p] {(parallel APT_OraWriteSubOperator in EM123)
on nodes (
node1[op2,p0]
)}
It runs 3 processes on 1 node.

ADC: When checking operator: When binding output interface field "MGR" to field "MGR": Implicit conversion; from source type "int32" to result type "string[38]": Converting number to string

main_program: Max inbound connections per node = 2
Max outbound connections per node = 2

main_program: Defining Section Leaders.

main_program: Contacting Section Leaders.

main_program: Broadcasting score.

node_node1: broadcastStepIR: score load from /D=/TMP/APTps2512cbcaefc1 on node node1 started.

main_program: Score (20240 bytes) sent.

main_program: Starting Players.

main_program: Waiting for Players to start.

main_program: Setting up data connections among Players.

main_program: Starting step execution.

main_program: Waiting for step completion.

ADC,0: Calling runLocally: step=0, node=node1, op=0, ptn=0

EM123,0: Calling runLocally: step=0, node=node1, op=1, ptn=0

EM123,0: Calling runLocally: step=0, node=node1, op=2, ptn=0

Some Addl Info: After going through some threads I changed APT_PM_SHOW_PIDS = false.Server jobs are working fine. Metadata for both columns is Decimal 38,0.


This OSH dump from my Laptop. After the last message, the job hangs.
I tried with Clean-up resources, Stopping DS Services & even Restarting laptop. but the message in the Dirtector displays Running & unable to run for second time. But server Jobs? No issues.
Please diagnose the Error & provide Solution.
Thanks in anticipation.

Vasa
Last edited by vasa_dxx on Sun Oct 05, 2008 7:31 am, edited 1 time in total.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

So you are reading a table and transferring it straight to another table in the job? After the job has "hung" and you've restarted the server, did you recompile or use Director -> Job -> Reset/Cleanup Resources/Clear Status File? Does it always hang, does it hang if you write to /dev/null on a text file? Does it hang if you generate sample data with a row generator stage?

p.s. The subject is a bad choice, perhaps "Oracle Write hangs" or something similar so that people know what the thread contents might be.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What error?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

@ ArndW

Post by vasa_dxx »

Thanx for pointing me.
Yes, I am writing it Directly to Oracle. I followed the below sequence:-
1.Used "Reset Job" option in Director. Waited for 30 min. No use.The Job status is displayed "Running".
2. Then I used "Clean Up Resources". No Use.The Job status is still displayed "Running".
3. I stopped DS Services.No use.The Job status is still displayed "Running".
4. I restarted Laptop. The Job status is displayed "Aborted".with foll. info
ADC,0: Calling runLocally: step=0, node=node1, op=0, ptn=0
EM123,0: Calling runLocally: step=0, node=node1, op=1, ptn=0
EM123,0: Calling runLocally: step=0, node=node1, op=2, ptn=0

So it Infinitely hangs.

@ray.wurold.
The jobs hangs infinitely. :)
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Ok. Have you narrowed it down to the write stage?
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

What is "E:\oracle\product\10.2.0\db_1\bin" in your PATH? You have a DB on your removeable drive? Where is your Oracle client?

Try to run the same task from your SQL Plus to make sure it's working first.
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

@Istsaur
Oracle is on Hard Drive E: & DS on D:
Drive D is formatted as NTFS file system & all other as FAT32.
Does the problem lies here??
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

The Job hangs only when I try to write to Oracle. Flat file stages are working fine.
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

Does it always hang, does it hang if you write to /dev/null on a text file? Does it hang if you generate sample data with a row generator stage?



Row Generator stage works to write to Flat file . Job hangs only when wrting to Oracle.
Two wrongs don't make a right. But three lefts do.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Does it hang if you use a 1-node configuration file?
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

ArndW wrote:Does it hang if you use a 1-node configuration file? ...
Yep. It hangs when 1-node config file is used.
Two wrongs don't make a right. But three lefts do.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

the full outout above is too much for me. Are you doing a load or normal table writes? Can you actually do an insert or update manually to this table?
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

ArndW wrote:the full outout above is too much for me. Are you doing a load or normal table writes? Can you actually do an insert or update manually to this table? ...
Yep. I did it successfully.
Two wrongs don't make a right. But three lefts do.
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

Did you mean you were able to insert or update table using SQL*Plus?
vasa_dxx
Participant
Posts: 39
Joined: Sun Sep 28, 2008 2:59 am
Contact:

Post by vasa_dxx »

lstsaur wrote:Did you mean you were able to insert or update table using SQL*Plus?
Yep. I did i.
Two wrongs don't make a right. But three lefts do.
Post Reply