teradata connector stage as source

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

teradata connector stage as source

Post by srivalli_b »

Hi,

I have worked in teradata connector stage as target.But I did not work as source. Now I need to use as source. For increase performence can I know the what properties I need to set.

arrry-size- 2000
record count-2000
access method- immediate
parallel synchronization- no
kwwilliams
Participant
Posts: 437
Joined: Fri Oct 21, 2005 10:00 pm

Re: teradata connector stage as source

Post by kwwilliams »

You're not really going to see performance improvement by working on the array size and the commit transaction. You could change the access method to bulk and then set the min and max sessions to settings recommended by your Teradata admins.
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

Post by srivalli_b »

Hi,

Thanks your mail.
my job:

teradata connector stage -> transformer -> teradata connector stage

But I am getting below warnings and fatal error


warning:
SRC_OPP_AVL,0: *** glibc detected *** /opt/IBM/InformationServer/Server/PXEngine/bin/osh: double free or corruption (out): 0x000000000230c760 ***
warning:
SRC_OPP_AVL,0: ======= Backtrace: =========
warning:
SRC_OPP_AVL,0: /lib64/libc.so.6[0x3a650750c6]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZNSbItSt11char_traitsItESaItEE4_Rep10_M_destroyERKS1_+0x9)[0x7f612f9511ff]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_Z29PXBridge_isMultiLinkSupportedRK10APT_StringP18CC_LoadedConnector+0xf1)[0x7f612f910fbb]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZN10PXBridgeOp10runLocallyEv+0x51c)[0x7f612f922644]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/liborchx86_64.so(_ZN15APT_OperatorRep3runEv+0x488)[0x7f6138421068]

fatal error :
SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGABRT


Please help me out
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

Post by srivalli_b »

after changeing to bulk mode I am getting above warnings and fatal error.
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

Post by srivalli_b »

I set the MALLOC_CHECK_=0 in job level and administrator side also.

Now above warnings are gone. But job is kepping on running.

Please help me
kwwilliams
Participant
Posts: 437
Joined: Fri Oct 21, 2005 10:00 pm

Post by kwwilliams »

What version of Teradata are you using and which Teradata Conector stage variant are you using? You can find the Teradata Connector variant when you open the stage.
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

Post by srivalli_b »

Hi,

Job is keep on running because of Table is locked. But I am getting below error.


Info:

SRC_OPP_AVL,0: Generated SELECT statement: SELECT AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGIN,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID FROM EFBI_DEV1_STG_S.CSPRO_OPP_AVL

Fatal error: SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGSEGV
kwwilliams
Participant
Posts: 437
Joined: Fri Oct 21, 2005 10:00 pm

Post by kwwilliams »

What version of Teradata are you using and which Teradata Conector stage variant are you using? You can find the Teradata Connector variant when you open the stage. (asked earlier seems we were posting at the same time)
srivalli_b
Participant
Posts: 32
Joined: Tue Dec 20, 2011 8:03 am

Post by srivalli_b »

thanks kwwilliams . I changed varient as 12.it is working.

But I have one issue.

my table is having 6,00,000 rows. with bulk option up to 420000 rows loaded properly. whenever I select more than 420000 it is not loaded.
it is throwing below error.

SRC_OPP_AVL,0: RDBMS code 2646: No more spool space in tdadmin. SQL statement: select AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGin ,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID from EFBI_DEV1_STG_s.CSPRO_OPP_AVl sample 500000 (CC_TeraParallelTransporter::getRow, file CC_TeraParallelTransporter.cpp, line 1,616)

source properties:

access method:Bulk
arrysize 2000
record count 2000
isolation level default

sleep 0
tenacity 0
maxsessions-8
maxpartition sessions- 0
min sessions- 8
max buffer size-1000000
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

srivalli_b wrote:RDBMS code 2646: No more spool space in tdadmin.
Take that error to your DBA.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply