Page 1 of 1

Use Virtual dataset as reference in lookup

Posted: Wed Apr 18, 2012 7:02 am
by deepa.y
Hi,
I have a job to take data from source ,lookup on a dataset,if no corresponding entry is present,append that record to same dataset by assigning an unique index to it so that the dataset have unique records..
My job looks as

Code: Select all

             dataset
                |
seq_file---->lookup---->dataset
When i execute the job,i am getting the following error.
Operator initialization: A link between two operators should be named with a .v; insert a copy operator to save a persistent copy of the data

I read some posts and understood that same dataset cannot be used more than once in a job and instead can use virtual dataset.
I am unaware of how to create virtual dataset and please let me know how can i implement it in the above scenario.

Posted: Wed Apr 18, 2012 4:11 pm
by ray.wurlod
The virtual data set is created and indexed automatically (by the LUT_CreateOp operator in the score). You don't have to worry about it.

Re: Use Virtual dataset as reference in lookup

Posted: Thu Apr 19, 2012 10:46 am
by rahcomp
If you are not contsrained with using just a single job
then preferable solution would be writing values in some intermediate dataset in JOB 1

and in JOB 2 , Intermediate dataset data can be appended to Required dataset.