Hi All,
My Source table is having 50 lacks records.i have applied few transformation rules in trasformer stage based on my requirements.my job is taking 40 minutes time to finish.
please let me know how to improve the performace in transformer stage.
Thanks in advance
improving the performance in transformer stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 81
- Joined: Thu Nov 30, 2006 7:46 am
- Location: india
-
- Participant
- Posts: 72
- Joined: Wed Dec 12, 2007 2:29 am
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Look for any opportunity for doing less processing, for example evaluating functions once in stage variables rather than many times in column derivation expressions, evaluating constants once when initializing stage variables rather than once per row, and so on. Once we see what you're doing more suggestions may be forthcoming.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.