Hi,
I need to filter records based on some conditions to three different path. Which is the best stage to use, is it the transformer or the filter?? The data input that we handle is around 4 million.
Filter versus transformer
Moderators: chulett, rschirm, roy
Re: Filter versus transformer
I prefer doing thru the transformer. In the new version greater tha 8, there is no filter stage.
Re: Filter versus transformer
Say what? Maybe in 8.2 but it's certainly there in 8.1.divesh wrote:In the new version greater tha 8, there is no filter stage.
And why would they take it out? Are there issues with it?
To original poster, try both, take the one that suits best, not as though it is a tough requirement with a large lead time...
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The Filter stage is in all 8.x versions.
Current advice from IBM is that the Transformer stage is to be preferred to the Filter or Switch stages, because the Transformer stage (nowadays) is compiled, while the other two are interpreted.
Current advice from IBM is that the Transformer stage is to be preferred to the Filter or Switch stages, because the Transformer stage (nowadays) is compiled, while the other two are interpreted.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 86
- Joined: Mon Nov 27, 2006 3:42 am
- Location: Wilmington
Switch Stage
Hi All, In my project we have million's data to filter out based on condition. could you please suggest me which is the best stage to use, Performance wise should be efficient. Transformer/Fillter/Switch. Thanks in advance.
-
- Participant
- Posts: 86
- Joined: Mon Nov 27, 2006 3:42 am
- Location: Wilmington
-
- Premium Member
- Posts: 1044
- Joined: Wed Sep 29, 2004 3:30 am
- Location: Nottingham, UK
- Contact:
I think the processing of the SQL WHERE clause style condition in a Filter stage is less efficient than processing a compiled Transformer expression.Magesh_bala wrote:Thanks for that, Stilll I am wondering to differentiate between Advantages of Transformer stage in version 8 with Filter and Switch stage.
Phil Hibbs | Capgemini
Technical Consultant
Technical Consultant