look up failed

samsuf2002 · Post by **samsuf2002** » Thu Sep 07, 2006 8:20 am

i have a look up which is joining a table that contain 40 million records with the input sequential file that contain same no. of records but when it reaches to this look up it is getting failed error i am gettin is "unable to operate on large objects"

please help
thanks

thumsup9 · Post by **thumsup9** » Thu Sep 07, 2006 8:27 am

Is this the only message you are getting in the log. Can you please post the log.

meena · Post by **meena** » Thu Sep 07, 2006 8:36 am

Hi,

Can you post the job error or warning messages.

RajaUsa75 · Post by **RajaUsa75** » Thu Sep 07, 2006 9:51 am

Hope you are using Lookup stage in Parallel job. Lookup stage process is RAM based and you may use it only for smaller lookup tables. For larger lookup tables, consider using DISK based stages such as JOIN. One problem with Join stage is that you can't have more than one lookup table. Good Luck!

ray.wurlod · Post by **ray.wurlod** » Thu Sep 07, 2006 3:41 pm

Not true. Join stage supports more than two inputs. They are called Left, Intermediate and Right. I believe that it still executes pairwise joins into intermediate result sets, however, the same as most database engines do.

clickart · Post by **clickart** » Thu Sep 07, 2006 3:53 pm

As Raja said, the Join stage is better than Lookup stage when volumes are high. You can still lookup on multiple tables by using a DB join in the database stage.

ray.wurlod · Post by **ray.wurlod** » Thu Sep 07, 2006 4:03 pm

The message about large objects suggests you're trying to return a CLOB or a BLOB. This is not supported.