Search found 37 matches

by sashah
Mon May 14, 2007 11:23 am
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Executing DSRunJob command

To execute the DSRun job comman from prompt do we need to write the script in C? The example in the Server Job Developers guide is written in C Both the Server Job Developers Guide and the Parallel Job Developers Guide have a chapter on job sequences, in which all available job sequence components a...
by sashah
Fri May 11, 2007 12:38 pm
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Is there anywhere that I can see an example of using the start and End Loop and User variables stages Thank you Thank you. I will try with the Sequence job. A 'better' answer would be to build a Sequence job using the new Start Loop, End Loop and UserVariables stages to get the list of files and run...
by sashah
Fri May 11, 2007 11:46 am
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Thank you. I will try with the Sequence job. A 'better' answer would be to build a Sequence job using the new Start Loop, End Loop and UserVariables stages to get the list of files and run the processing job iteratively, passing it a new filename each time. What version of DataStage do you have, one...
by sashah
Fri May 11, 2007 10:44 am
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Execution Of DataStage Job

Is there a way to execute a datastage job from a shell script. I have a unix script which reads a directory from files and would like to execute the datastage job for each file.

Thanks for your help
by sashah
Fri May 11, 2007 7:37 am
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Concatenation of Files

Thank you for your reply. I will try it. The easiest way would be to issue the wildcard 'cat' before-job using ExecSH to a fixed filename. Check under the Job Properties tab if you're not sure where that lives. Or try doing it in the Filter option of the Sequential file stage as others have mentione...
by sashah
Fri May 11, 2007 7:25 am
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Concatenation of files

Thank you for the reply. How would I go about doing the concatenation of file from within Datastage.
chulett wrote:Welcome! :D

Typically, concatenation then process the concatenated file. Or a looping Sequence to read the filenames and repeat a processing job once per filename. ...
by sashah
Thu May 10, 2007 3:31 pm
Forum: General
Topic: Processing files in a directory
Replies: 44
Views: 14961

Processing files in a directory

What would be the best way to persist data from multiple files residing in a directory to a Oracle Database. All the files have to same structure. I tried using folder stage but was not successful.