DSXchange

HI, I am in a position to decide whether to use the surrogate key generator or oracle sequence for creating unique ids. My requirement is to generate sequence numbers based on the existing max number we have in the table. I have done that using oracle seuqence--i.e in the insert statement, i have us...

HI, In the input i have 3 columns ColA,ColB,ColC with the following values MOS,MMS,PX And i have a reference link(table) where all the valid values for these columns are stored in a table like below Col1,Col2 with the following values ColA,MOS ColB,MMS ColC,PX. I want to validate whether the value i...

Hi, Can anyone tell what are the disadvantages of using a job sequencer.. Actually we have the scheduling tool, so i am planning to have separate ETL jobs called from the scheduling tool..but we can have one job sequencer to call all the jobs and execute..I feel restartability is little complex usin...

Hi I have around 20 million rows in the input table which is a dimension table. Every day there can be around 200-300 new rows coming in and around 500 update records where the value for some of the column changes. I am trying to see how i can use the lookup stage to capture these updates. If i just...

Hi, I have double quotes inside the data. While reading, i am getting this error with 'delim=end' did not consume entire input, at offset: 317 Ex "1"|"9999"|"Exbis"|"MC"kh""|"" I searched the forum and i couldnt find any resolution to handl...

Yes, i have given three different scenarios.

For example Job1 needs to be processed for different sets of files with different keys

Hi, We are doing similar processing with ETL jobs so wanted to know how we can make it configurable. For ex: Job 1 1.Extract from an oracle table and write in in a fixed width file. Here we would need to change the columns and use a user defined query for selection. 2. Extract from an oracle table a...

It is a full DB refresh. so i am going to go only for Oracle Bulk load..Upsert would be very time consuming. I just wanted to check the restartability in Oracle Bulk Load.

Hi,

I have around 100 million rows to be loaded in a table as a refresh and this happens every week. If the job aborts in the middle say after loading around 70 mil rows..is there any way to re-start it and load only the remaining 30 mil rows?

Thanks a lot . it worked.

Hi,

There is an existing logic in a shared container. I want to use that same logic and make it as a new job. Do we have any simple way of doing this or should i start the job from scratch?

Hi, Thanks. I am not sure whether Auto-partition is best to use. So i thought i would use hash partition. But just wanted to clarify whether it is necessary to change for sparse lookup.

Hi, I have a file with around 20 mil data which i have to join with a table with around 200 mil data. All the records in the file are having unique keys. The key is a varchar character. In this situation , i think hash partitioning is the only best available partitioning isnt it?. Or can we use anyt...

Hi,

Does changing the partition for a Sparse lookup have any effect, since it is directly firing the queries to the DB?. I have all the stages with Auto partition, but just wanted to know whether changing the partition for a sparse lookup will have any impact.

Hi, I have a simple job which reads from a file and updates a particular field in a oracle database. The file has around 20 mil record and the commit count is 10000. The partition type is Auto(havent changed anything). Now the job aborted in the middle due to oracle instance being down. It had updat...