DSXchange

Thank You. Where do I find this word contention

when I ran single instance 20,306 records are processed per second. And 1685 rows/sec were processed when 6 instances of the same job were running concurrently. the jobs were running with a 2x1 configuration file.

Thanks
Mark

I am having a performance issue with a job I am working running currently. The source is a fileset. the job read around 3 million records. when I ran the job it completes in 2 minutes. when I run the same job 6 instances at a time then each instance takes around 25 minutes, out of which 23 minutes i...

I use this to get the total record count and from a shell script I send an email to the team.

Count=`dsjob -linkinfo $Project $Job $Stage $Link | grep 'Link Row Count' | awk '{print $5}'`

mail -s team.com

Thanks
Mark

Thanks. I was able to find the record count in the job1. How Do I send the total record count in an email to the team from the sequence?

Thanks
Mark

sequence ---Job1 ---Job2

The sequence contains 2 datastage jobs. I have to fnd the total count in the job1 and send an email notification.

Thanks
Mark

Thank You. I have couple of questions;

There is a environmental parameter @INROWNUM gives me number of records processed however, how can I capture count in a transform routine? and How can pass this count to a sequence?

Thanks
Mark

Hi All, I have a datastage job (parallel edition) that counts the numbers of records processed and writes to a text file (or it can write to a peek stage) After the job completes successfully, I have to send an email to the team with total number of records processed. There is Notification_activity ...

The jobs which used to run in 35-45 minutes are taking hours to complete. so i trying to know where the bottleneck could be. when I run this ps -ef | grep osh | wc -l before the job starts it is around 300 and then it shoots all the way to 856 while the job is executing. can someone suggest me where...

I find these in the dsparams file

RTLogging=1
ORLogging=0

There are 65 files in the &PH& directory

Thanks
Mark

can you also please explain what do you mean by fragmented file structure.

How do I know if it is happenning in my environment?

Thanks
Mark

Thanks Paul. More files are being created in that directory. This started recently and I am trying to understand what why it is happenning. The OS is AIX 5.3 The start up time for some jobs is horrible. 1 hour 32 minutes, it used to be 1 or2 seconds in the past. also the run for the jobs are now 7 h...

Hi all,

Can anyone suggest me how can i find the number of process datastage job is creating?
Can the number of processes in the &PH& directory slow down the performance of a datastage job?

Thanks
Mark

My business requirement expects me to write output file in xml format only. The output record count is 3 million approximately. Currently the xml output stage is running sequentially and the xml stage performance is slow (20 rows/sec). Can anyone please tell me if I can run the xml output stage in p...

I don't have a sort stage in my job. I am curious to know how can I find out I/O through put, memory usage and CPU usage while the job is executing.

Thanks
Mark