Extracting at different times

[vsi]

Hi,

I am creating Client Dimensions. With relationship as follows

Code: Select all

                -------< clt_dim1
              /
dim_clt   ---------< clt_dim2

I have extract jobs for dim_clt (10), clt_dim1(5), clt_dim2(5).

I have few questions on the design.

a) As dim_clt has to be done prior to clt_dim1, clt_dim2. Does this mean that even the extract jobs should be done prior or shall i do the extracts of all at the same time.
--> My guess all at the same time.

b) If one extract job fails, do we need to extract all - to be in sync??
--> My guess to extract all

[I_Server_Whale]

a) As dim_clt has to be done prior to clt_dim1, clt_dim2. Does this mean that even the extract jobs should be done prior or shall i do the extracts of all at the same time.
--> My guess all at the same time.
"Correct"

b) If one extract job fails, do we need to extract all - to be in sync??
--> My guess to extract all
Usually, No need to extract all.

[Krazykoolrohit]

Extraction does not depend on any of your relationships as far as none of your tables get updated. So if you have extracted dim_clt and then while extracting clt_dim1, dim_clt adds/delete on one more row then you may face difficulties as far as referential integrity is concerned.

So to be on safer side i guess you should do all the extractions simultaneously everytime. (assuming that the data in one table can get updated while you are extracting another)

[narasimha]

a) As dim_clt has to be done prior to clt_dim1, clt_dim2.

If dim_clt has to be done prior to clt_dim1, clt_dim2
Then extract jobs for dim_clt should be done prior to clt_dim1, clt_dim2.
Unless there is there no dependencies of clt_dim1, clt_dim2 on dim_clt.
Did I understand you right?

[Krazykoolrohit]

a) As dim_clt has to be done prior to clt_dim1, clt_dim2.

If dim_clt has to be done prior to clt_dim1, clt_dim2
Then extract jobs for dim_clt should be done prior to clt_dim1, clt_dim2.
Unless there is there no dependencies of clt_dim1, clt_dim2 on dim_clt.
Did I understand you right?

Its not loading of tables hes talking about. Its just extraction.

[vsi]

Thanks, got it, I will extract them at the same time.

[narasimha]

Its not loading of tables hes talking about. Its just extraction.

My bad, I did not understand it correctly!