problem loading huge data into dataset
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 16
- Joined: Thu Sep 08, 2011 8:29 am
- Location: hyderabad
problem loading huge data into dataset
Hi All,
I want to write huge amount of data from a table into a dataset.
Number of records are almost equal to 17crores.
After loading 11crore records job is getting aborted. I'm getting the below errors
TGT_RM_IMAGE_LOC: ODBC function "SQLEndTran(SQL_ROLLBACK)" reported: SQLSTATE = 08S01: Native Error Code = 0: Msg = [IBM(DataDirect OEM)][ODBC Oracle Wire Protocol driver]Socket closed.
TGT_RM_IMAGE_LOC: [IIS-CONN-ODBC-000004] ODBC function "SQLEndTran(SQL_ROLLBACK)" reported: SQLSTATE = 08S01: Native Error Code = -4: Msg = [IBM(DataDirect OEM)][ODBC Oracle Wire Protocol driver][Oracle]Connection Dead. (CC_OdbcConnection::rollback, file CC_OdbcConnection.cpp, line 953)
Job design:
ODBC---->COPY STAGE--->DATASET
can someone help me out.
Thanks in advance.
I want to write huge amount of data from a table into a dataset.
Number of records are almost equal to 17crores.
After loading 11crore records job is getting aborted. I'm getting the below errors
TGT_RM_IMAGE_LOC: ODBC function "SQLEndTran(SQL_ROLLBACK)" reported: SQLSTATE = 08S01: Native Error Code = 0: Msg = [IBM(DataDirect OEM)][ODBC Oracle Wire Protocol driver]Socket closed.
TGT_RM_IMAGE_LOC: [IIS-CONN-ODBC-000004] ODBC function "SQLEndTran(SQL_ROLLBACK)" reported: SQLSTATE = 08S01: Native Error Code = -4: Msg = [IBM(DataDirect OEM)][ODBC Oracle Wire Protocol driver][Oracle]Connection Dead. (CC_OdbcConnection::rollback, file CC_OdbcConnection.cpp, line 953)
Job design:
ODBC---->COPY STAGE--->DATASET
can someone help me out.
Thanks in advance.
Naresh
DataStage Developer
DataStage Developer
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 16
- Joined: Thu Sep 08, 2011 8:29 am
- Location: hyderabad
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Use a Data Set. The operator is copy (whereas it's export for a File Set), which is bound to be more efficient.
The problem was with Oracle, not with your chosen staging technique,
The problem was with Oracle, not with your chosen staging technique,
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.