DSXchange

Hi,

The performance has improved and because of that we are not getting the snapshot too old error anymore.

but what i am asking is about the root cause..

No, the DBA didnt make any changes to the table or the setup. After extracting the records which satisfy the join condition i am writing it into a hashed file which is being used as a reference for a lookup. This hashed file is used as reference and is being updated also, after lookup. There were tw...

Hi, To my surprise , i made few changes to the subsequent stages to improve performance and this issue doesnt come up any longer. I didnt touch the OCI stage or the oracle tables. the issue is solved, but i am trying to figure out the root cause so that i can keep this in mind when i design some oth...

hi, my problem here is the volume of the data is so huge and even if we try to replicate the db,the time it would take would really be high i guess. we have nearly 60-70 files daily which would have around 0.1 mil to 0.5 mil each. our batch timing is for around 8 hours to complete all the processing...

Hi, I am joining a stage table(around 0.3 millions) with the main table(around 180 millions) based on key columns in the OCI stage using SQL. But the main table is quite busy all the time, --selects, inserts and updates are being done simultaneously on the same table. Hence this join takes too much ...

Hi,

We are actually reading the hash file as reference and updating in the same file. after adding the key the performance has degraded extremely. Is there any way to overcome this situation

Hi, We recently made some code changes to an existing job. The hash file had one key and we added one more key(so now it has combination key) now. After this code change we are having tremendous performance issue. it is processing at 3 rows/sec where we are dealing with 150 millions of records. Earl...

Hi,

I want to count the number of rows coming through a link and store the value in a file. If i use the aggregator it is counting the records only in groups but not the total number of records. I have unique records in every row.
how can i count the total number of records in a file.

Hi, I am triggering DS jobs from a script and capturing the -jobstatus in the script and execute other commans accordingly. Offlate i am facing problems with few of the jobs that run for long. when a job runs for more than a day or two. The script says Waiting for job... but the jobs are completed i...

we are truncating the records in the table and then only loading it.

Hi, We are doing a table refresh i.e we are loading the data from a sequential file to table. I have an id column in the table which should be unique. I am passing outrownum as the value for that. But the job is aborting with unique constraint violation. how is this possible. i changed the job to ta...

Hi, I have a job where i am generating the sequence number through KeyMgtGetNextValueConcurrent('N') and storing in unique id. The job.invocation id aborted with ORA-00001: unique constraint violation on the unique id index. When i check the current max value of the database and the value in SDKSequ...

Hi, I am trying to reset and run an aborted job from the command prompt, but the job doesnt run. It gives me a msg like this Waiting for job... Finished waiting for job Job Status : (3) Status code = 3 I used this command:- $DSHOME/bin/dsjob -run -mode RESET -warn 50 -jobstatus -local proj job_name ...

i tried to convert the input format to yyyy-mm-dd hh24:mi:ss using substring in transformer stage and it worked. but i think substring might take longer time than iconv-oconv. so i am trying to convert using iconv.

i am using the transformer stage.

And the oracle's default date format is

SQL> select sysdate from dual;

SYSDATE
---------
11-AUG-08