Progress percentages in Log

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ravij
Premium Member
Premium Member
Posts: 170
Joined: Mon Oct 10, 2005 7:04 am
Location: India

Progress percentages in Log

Post by ravij »

Hi,

When I run the job, I am getting the log like this given below. In that Progreess percentages given like 10 percentage, 20, n so on....
How it is calculating n giving with the interval 10 for all the progress upto 100.

My log file is like this:

DataStage Report - Summary Log for job: RowGen2Seq_Entire
Produced on: 12/15/2005 11:54:20 AM
Project: ravi Host system: proxy-1
Items: 1 - 22
Sorted on: Date Sorter

Occurred: 11:37:24 AM On date: 12/15/2005 Type: Control
Event: Starting Job RowGen2Seq_Entire.

Occurred: 11:37:24 AM On date: 12/15/2005 Type: Info
Event: Environment variable settings: (...)

Occurred: 11:37:24 AM On date: 12/15/2005 Type: Info
Event: Parallel job initiated (...)

Occurred: 11:37:24 AM On date: 12/15/2005 Type: Info
Event: Parallel job default NLS map ISO-8859-1, default locale OFF

Occurred: 11:37:25 AM On date: 12/15/2005 Type: Info
Event: main_program: Ascential DataStage(tm) Enterprise Edition 7.5 (...)

Occurred: 11:37:25 AM On date: 12/15/2005 Type: Info
Event: main_program: orchgeneral: loaded (...)

Occurred: 11:37:26 AM On date: 12/15/2005 Type: Info
Event: main_program: APT configuration file: C:/Ascential/DataStage/Configurations/default.apt (...)

Occurred: 11:37:26 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 10 percent

Occurred: 11:37:26 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 20 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 30 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 40 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 50 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 60 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 70 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 80 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Progress: 90 percent

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Src_SeqFile,0: Import complete. 10000 records imported successfully, 0 rejected.

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Tgt_SeqFile,0: Export complete. 10000 records exported successfully, 0 rejected.

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: main_program: Step execution finished with status = OK.

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: main_program: Startup Time 0:02 Production Run Time 0:00

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Info
Event: Parallel job reports successful completion

Occurred: 11:37:27 AM On date: 12/15/2005 Type: Control
Event: Finished Job RowGen2Seq_Entire.

End of report.


Any answer can be appreciated.

Thanks in Advance
RK
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Row count.

The sequential file is being read on node number 0 but, since it's being processed in sequential mode, the node identifier doesn't need to be reported during progress. The total row count does include the node identifier, since it is likely to be the source for partitioning.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
just4geeks
Premium Member
Premium Member
Posts: 644
Joined: Sat Aug 26, 2006 3:59 pm
Location: Mclean, VA

Post by just4geeks »

Can we disable seeing progress in the director log?
is there any envronment variable we can set/unset to enable/disable percentage progress?
Attitude is everything....
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There's a Report Progress (or similar) property in the Sequential File stage. The property takes a yes/no value, default is yes. Change it to No to prevent progress reporting.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
just4geeks
Premium Member
Premium Member
Posts: 644
Joined: Sat Aug 26, 2006 3:59 pm
Location: Mclean, VA

Post by just4geeks »

Great..Thank you Ray!
I actually saw this property before and knew it is there somewhere . I forgot that it is set in stage. I was searching through environment variable all this time..

Thank you so much!
Take care!
Attitude is everything....
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Funny but that was news to me, guess I never noticed it. Good to know! :D
-craig

"You can never have too many knives" -- Logan Nine Fingers
jgreve
Premium Member
Premium Member
Posts: 107
Joined: Mon Sep 25, 2006 4:25 pm

"with no elephants..."? *groan*

Post by jgreve »

ray.wurlod wrote:An ETL design with no elephants is irrelephant.
"with no elephants..."? *groan*
That was especially bad :-)

Hmm... so if something is irrelephant, does that make it off-tropic?
Post Reply