DSXchange

I have a parallel job, its a plain one to one mapping. Source is Oracle( oracle connector ) and the target is DB2( DB2 Bulk Load ). My problem is the source has 2.36 billion records and I have to optimize the job so that it shud finish within 5-6 hours. Plz suggest. My experience to such high volum...

Another possibility to improve the load performace, but not using the DataStage, which we used on database other than Oracle. Have your Load files exported per partition. As others recommended drop the constraints & indexes on the table, this can happen at the same time when your load files are ...

I have adopted the path suggested by chulette, & I have modified ExecSH subroutine, to raise Fatal error, in case a script happens to run into failure.

This worked for me ...

Thanks all for your contribution.

chulette - Are you referring to write a Shell script, which checks file size & call DS routine ? or write a DS routine itself ExecSH ? Gaurav - We already have that solution elsewhere, but limitation with this approach, you will never realize which all entries are offending, because after very f...

In our job design, We are filtering out offending entries from the DB, after the previous copletion of ETL operation. These filtered entries we are expected to direct to a sequential file. If this sequential file at the end of the job is non-empty, is there any way we can abort the job, so further s...

I have handled the nulls after retrieved from the database. While running a select, whichever columns were nullable, I have applies coalesce (db2 function) & replaced it with a space.
This suppressed the warning we received.

Thanks all for your valuable comments.

Hi After job execution, we are getting following warnings - APT_CombinedOperatorController,3: Field '<fieldname>' from input dataset '0' is NULL. Record dropped. In my job I have following sequence - Db2 EE Stage -> Transformer -> Seq File As the number of logs exceed the view limit, there is no ind...

For an DB EE stage, one can attach reject link, which could indicate insert or update SQL failure. On this Reject link, having transformer with constraint abort after 1 rows, would ensure the job gets aborted. But my problem still not solved, as I cannot use DB EE stage, since the target database I ...

Hi Ajay

We are not calling this DS job using sequencer. We are calling DS job using dsjob through ContolM.

Anyway, is there a possibility of trapping warning, from one particular stage using sequencer ?

Thanks & regards,
Vikram.

We came across situation where we insert / update to the database, at that time if that operation fails we received warning in job execution log. Even though insert / update did not work as expected, DS job finished successfully. But the negative effect of this is seen in further execution. What we ...

Thanks it helps...

What is the difference of Stopping a job through DS Director & through kill -9 option for the DS job execution ?

I have noticed kill -9, not necessarily work always.

Hi After I did 'orchadmin diskinfo -a' it showed information for all nodes. In this information it had displayed total diskspace. But the same is not matching with if I check using df command on unix. df command is showing more diskspace is allocated for node than shown by orchadmin. Is there any re...

This means FLTABSZ has no relation with timeout error. As the sequential files which are read, are not Big. Some of them are empty. Hence for this DataStage job, which is being run in multiple instance reading these sequential files, which setting can solve this problem of timeouts? As we have many ...

Hi Richdhan We get this error mentioned when job is accessed to run by scheduling component. Interestingly in DS Director, we dont get the log of this message, as this was a timeout. Its more I could see many number of jobs try to read files from the disk. Also which environment variable best define...