DSXchange

Join Stage in EE will perform full outer join to many tables. Also, one may do the left outer join using SQL. If one has more than two tables to join, I would recommend to use Join Stage in EE over using the database.

I do create a folder for datasets and create sub folders one for the descripter and one for the data
e.g.
dataset
-data
-desc

You can capture job log using dsjob -report in your unix script. Also check DataStagemanual for dsjob -logsum, dsjob -jobinfo, dsjob -logdetail, and others which may meet your needs.

Use Stage variable.
compare prev to curr
set max
Save previouse value

Build your sql in two steps: First step is to build your sql ( Using Read Method) using SQL Builder generated SQL; this step will provide you with columns so you do not have to type them manually. Second step is to change the Read Method to User-defined SQL, then keep the columns part and modify the...

Utilize UNIX cat command, cat file1 file2 file3 > outputfile, in the after routine in the job properties.

There are many ways to do this and it depends on your design: The method I used to implement this is in unix: 1) Use dsjob in a script to run the first job and write the parms to a parms file. 2) In a UNIX script, source the parms from the parm file, use dsjob to run the second and pass the parms vi...

Increase the timeout for the job and the Stage.