ODBC parallel reading
Posted: Wed Oct 14, 2009 7:47 am
Hi guys,
Did you know you could read from ODBC with parallel method :
1) Set partition column in the ODBC stage using a numerical field that is ideally a key.
2) edit the SQL clause and add 'WHERE %orchmodColumn%'
3) In the next stage which dispatches data onto nodes, use the Modulus method on the same partition key.
This works great but I cannot use this method with a Varchar key.
Does anyone know about this trick ?
Arnaud
Did you know you could read from ODBC with parallel method :
1) Set partition column in the ODBC stage using a numerical field that is ideally a key.
2) edit the SQL clause and add 'WHERE %orchmodColumn%'
3) In the next stage which dispatches data onto nodes, use the Modulus method on the same partition key.
This works great but I cannot use this method with a Varchar key.
Does anyone know about this trick ?
Arnaud