Page 1 of 1
timeout in ipc stage
Posted: Wed Jan 24, 2007 8:47 am
by parvathi
Hi all,
I have logic that is implemented as below, first i truncate all the target tables partitions and then only the loading of the data from the source to target will take place.while loading i used an IPC stage and set the time out to 10
I have doubt whether this timeout will be sufficient for truncating all the partitions before my load of data starts.
I have run the job no error till now. BUt i am suspecting because there are crores of records in the trget.
Posted: Wed Jan 24, 2007 8:54 am
by ArndW
The truncation portion of your job occurs outside of the IPC stage timeout.
Posted: Wed Jan 24, 2007 9:21 am
by parvathi
ArndW wrote:The truncation portion of your job occurs outside of the IPC stage timeout. ...
The process flows like this
oraclestage---transformer--- IPC----target
------------------------- |
------------------------- |
successfulltruncate partition
i have delayed the process such that only after successful compeletion of trncation then the loading from soucre to taget stage takes place
Posted: Wed Jan 24, 2007 9:48 am
by kris007
ArndW's statement answers your doubts. IPC stage doesn't timeout if your truncate process takes long. It would help us if you can show the process flow clearly by putting code or image tags around them.
Posted: Wed Jan 24, 2007 9:49 am
by DSguru2B
Or just increase the timeout period.
Posted: Wed Jan 24, 2007 10:13 pm
by parvathi
kris007 wrote: IPC stage doesn't timeout if your truncate process takes long. It would help us if you can show the process flow clearly by putting code or image tags around them.
Code: Select all
sourceoracle----transformer----IPC---target
|
|
|
input---procedure--transformer---hashedfile
for truncating
after truncating is done fully then only loading from the source to target takesI will be loading around 3.5 crores of records
Does the timeout out depend on the time taken to retrieve therecords from the source oracle store it in the buffer and insert in to the target or
does it depend on the time taken for truncating the table as i am delaying the process if insertion through the hashed file