Hi All,
I am loading 1.2 billion to my fact table, I have used LOOKUP stage to join all the dimentions. When I kicked off the job it has started at very good seed but when it had reached to .5 billion, It got aborted ...Log file showing UNIX Signal SIGKILL 9...that means that job has aborted forcefully....And when i looked into status of unix box....one folder with /Dev/fstst....it is showing used memory 100%...My source and target is DB2.
Can any one help me....what could be the reason
Thanks in Advance
stiwari
Getting UNIX Signal KILL....
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Technically, of course, every UNIX signal can be generated by a kill command. In this case a process has - as you noted - been forcefully terminated with a SIGKILL signal (kill -9).
Yes, the Lookup stage does use scratch space if it needs to. The Lookup stage in normal mode is (generates) a composite operator - one to read in ALL the lookup data (for example into a virtual Data Set), the second to perform the actual lookup processing. Building a virtual Data Set consumes memory.
You may need to find a better strategy for combining your Data Sets.
Yes, the Lookup stage does use scratch space if it needs to. The Lookup stage in normal mode is (generates) a composite operator - one to read in ALL the lookup data (for example into a virtual Data Set), the second to perform the actual lookup processing. Building a virtual Data Set consumes memory.
You may need to find a better strategy for combining your Data Sets.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Check in your DS Adminstrator setting for environmental varialbe TEMP_DIR, if it is pointing to this directry, it is used as scratch space.
Else check your Config file, you can find if it is been used as one of the resource pool.
Else check your Config file, you can find if it is been used as one of the resource pool.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Your UNIX administrator will be able to tell you whether that is a device that you are not supposed to be using, or part of the file system. To me the name "fstst" suggests "file system test" which in turn suggests that you may not be supposed to be there.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.