DSXchange

Thanks Ray,
Cheers,
Munish

Hi All, Could I please request you champs to comment on the following: Question/Suggestion related to Oracle Stage: 1. Original question which we have sorted out: "We are planning to use bitmap indexes on our fact tables. We're currently experiencing some issues with our ETL load due to the way...

I'm having the same error message when running with a sample data of 6000 records but no problem with 600 records! both samples are considered very small since the real job will be over 20 million records!

Yes

I went through the search and found it very informative.
However,
I am just wondering if other than duplicate primary keys, break in referential integrity can cause this error.

Thanks,
Munish

Hi Champs, I am using Oracle Load to load my fact table. Volume: 280 mills per load. The DB is partitioned by date. We have 7 bitmap indexes on this table. The problem starts after the data is loaded and when OCI stage tries to rebuild the indexes and it is failing there. The error: ORA-01502: index...

Hi All,
I am closing this job and opening a new thread.
Thanks,
Munish

Hi Champs, I am using Oracle Load to load my fact table. Volume: 280 mills per load. The DB is partitioned by date. We have 7 bitmap indexes on this table. The problem starts after the data is loaded and when OCI stage tries to rebuild the indexes and it is failing there. The error: ORA-01502: index...

Sure, Would definitely do that. It is one of things to do in our SVT. In current job, Source 1: Key values + sum Source 2 : Key valued + count join output: Keyvalues + Sum + Count. Thus, it is very simple inner join. We have started the development with JOIN stage, however we are going to compare it...

Hi All,
My job can be done by
either Merge or Join.

I was just wondering which one is more efficient, considering the DataSet may have around 300 mills rows.

Thanks,
Munish

Thanks to all of you for giving helpful advices. It is done. A few facts to share: 1. Tall/Head stage: It gets the top or bottom values from each of the node. Since our dev env has 2 nodes. It was getting the records one from each node. Got it rolling: Once I did the aggregation > used sort stage wi...

1. My sort stage where I am using Key_Change property has 3 keys only. Ac_N,Serv_N,Period_K 2. Use of first sort stage is to make the aggregator work easier. (We are anticipating 280 Mills rows in one batch.) 3. KeyChange is doing right be putting 1 whenever key combination (Ac_N,Serv_N,Period_K ) c...

Key fields are as mentioned
Ac_N,Serv_N,Period_K

But I want to see the record with Called_Num and amt.

Is there any thing wrong or should I be doing it in a different way.

Thanks,
Munish

Hi There, It seems I am missing something here. I have reached a place where I have recordset with Group and aggregated amount in descending order. It looks like Ac_N,Serv_N,Period_K,Called_Num,(Amt,KeyChange_Key or ClusterKeyChange_Key) 4,1041,11,"870602299"," 001716.00","1...

Hi All, I am very near to solve this mystery. as per the suggestions, what I plan to do Sort>> Aggregate >> Sort (Group and respective amt (descending)) >> Another Sort (For Keychange)>> Filter stage (restrict Keychage Counter) However, I am held up at use KeyChange column for the counter when I use...