teradata connector stage as source
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
teradata connector stage as source
Hi,
I have worked in teradata connector stage as target.But I did not work as source. Now I need to use as source. For increase performence can I know the what properties I need to set.
arrry-size- 2000
record count-2000
access method- immediate
parallel synchronization- no
I have worked in teradata connector stage as target.But I did not work as source. Now I need to use as source. For increase performence can I know the what properties I need to set.
arrry-size- 2000
record count-2000
access method- immediate
parallel synchronization- no
-
- Participant
- Posts: 437
- Joined: Fri Oct 21, 2005 10:00 pm
Re: teradata connector stage as source
You're not really going to see performance improvement by working on the array size and the commit transaction. You could change the access method to bulk and then set the min and max sessions to settings recommended by your Teradata admins.
Keith Williams
keith@peacefieldinc.com
keith@peacefieldinc.com
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
Hi,
Thanks your mail.
my job:
teradata connector stage -> transformer -> teradata connector stage
But I am getting below warnings and fatal error
warning:
SRC_OPP_AVL,0: *** glibc detected *** /opt/IBM/InformationServer/Server/PXEngine/bin/osh: double free or corruption (out): 0x000000000230c760 ***
warning:
SRC_OPP_AVL,0: ======= Backtrace: =========
warning:
SRC_OPP_AVL,0: /lib64/libc.so.6[0x3a650750c6]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZNSbItSt11char_traitsItESaItEE4_Rep10_M_destroyERKS1_+0x9)[0x7f612f9511ff]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_Z29PXBridge_isMultiLinkSupportedRK10APT_StringP18CC_LoadedConnector+0xf1)[0x7f612f910fbb]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZN10PXBridgeOp10runLocallyEv+0x51c)[0x7f612f922644]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/liborchx86_64.so(_ZN15APT_OperatorRep3runEv+0x488)[0x7f6138421068]
fatal error :
SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGABRT
Please help me out
Thanks your mail.
my job:
teradata connector stage -> transformer -> teradata connector stage
But I am getting below warnings and fatal error
warning:
SRC_OPP_AVL,0: *** glibc detected *** /opt/IBM/InformationServer/Server/PXEngine/bin/osh: double free or corruption (out): 0x000000000230c760 ***
warning:
SRC_OPP_AVL,0: ======= Backtrace: =========
warning:
SRC_OPP_AVL,0: /lib64/libc.so.6[0x3a650750c6]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZNSbItSt11char_traitsItESaItEE4_Rep10_M_destroyERKS1_+0x9)[0x7f612f9511ff]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_Z29PXBridge_isMultiLinkSupportedRK10APT_StringP18CC_LoadedConnector+0xf1)[0x7f612f910fbb]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/pxbridge.so(_ZN10PXBridgeOp10runLocallyEv+0x51c)[0x7f612f922644]
warning:
SRC_OPP_AVL,0: /opt/IBM/InformationServer/Server/PXEngine/lib/liborchx86_64.so(_ZN15APT_OperatorRep3runEv+0x488)[0x7f6138421068]
fatal error :
SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGABRT
Please help me out
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
-
- Participant
- Posts: 437
- Joined: Fri Oct 21, 2005 10:00 pm
What version of Teradata are you using and which Teradata Conector stage variant are you using? You can find the Teradata Connector variant when you open the stage.
Keith Williams
keith@peacefieldinc.com
keith@peacefieldinc.com
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
Hi,
Job is keep on running because of Table is locked. But I am getting below error.
Info:
SRC_OPP_AVL,0: Generated SELECT statement: SELECT AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGIN,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID FROM EFBI_DEV1_STG_S.CSPRO_OPP_AVL
Fatal error: SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGSEGV
Job is keep on running because of Table is locked. But I am getting below error.
Info:
SRC_OPP_AVL,0: Generated SELECT statement: SELECT AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGIN,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID FROM EFBI_DEV1_STG_S.CSPRO_OPP_AVL
Fatal error: SRC_OPP_AVL,0: Operator terminated abnormally: received signal SIGSEGV
-
- Participant
- Posts: 437
- Joined: Fri Oct 21, 2005 10:00 pm
What version of Teradata are you using and which Teradata Conector stage variant are you using? You can find the Teradata Connector variant when you open the stage. (asked earlier seems we were posting at the same time)
Keith Williams
keith@peacefieldinc.com
keith@peacefieldinc.com
-
- Participant
- Posts: 32
- Joined: Tue Dec 20, 2011 8:03 am
thanks kwwilliams . I changed varient as 12.it is working.
But I have one issue.
my table is having 6,00,000 rows. with bulk option up to 420000 rows loaded properly. whenever I select more than 420000 it is not loaded.
it is throwing below error.
SRC_OPP_AVL,0: RDBMS code 2646: No more spool space in tdadmin. SQL statement: select AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGin ,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID from EFBI_DEV1_STG_s.CSPRO_OPP_AVl sample 500000 (CC_TeraParallelTransporter::getRow, file CC_TeraParallelTransporter.cpp, line 1,616)
source properties:
access method:Bulk
arrysize 2000
record count 2000
isolation level default
sleep 0
tenacity 0
maxsessions-8
maxpartition sessions- 0
min sessions- 8
max buffer size-1000000
But I have one issue.
my table is having 6,00,000 rows. with bulk option up to 420000 rows loaded properly. whenever I select more than 420000 it is not loaded.
it is throwing below error.
SRC_OPP_AVL,0: RDBMS code 2646: No more spool space in tdadmin. SQL statement: select AVL_UID,SEQUENCE,DIR_UID,RES_UID,USR_ID,LASTUPDATE,RES_LEVEL,RSDATE,RFDATE,CLH_UID,PALLOC_UID,SRC_SYS_ID,LOAD_ERROR,DATA_ORIGin ,CREATED_EW_DTTM,LASTUPD_EW_DTTM,BATCH_SID from EFBI_DEV1_STG_s.CSPRO_OPP_AVl sample 500000 (CC_TeraParallelTransporter::getRow, file CC_TeraParallelTransporter.cpp, line 1,616)
source properties:
access method:Bulk
arrysize 2000
record count 2000
isolation level default
sleep 0
tenacity 0
maxsessions-8
maxpartition sessions- 0
min sessions- 8
max buffer size-1000000