DSXchange

I think one possible option will be exporting Datasatage project into Unix file and performing grep operation for perticular column. It will give you in which Datastage jobs that column is used.

Check metadata and Final delimiter property of your sequence file stage.
Also try to do view data on Sequential file stage before running job.

Please check partitions on look up link.

Duplicates can be captured by following stage:

Dataset ----> sort ( on key columns ) ---> aggregator ( on key columns + count operation ) ---> filter ( count > 1 ) ---> sequencial file

Try using combination of following functions

1. Trim
2. Length

Trim function will return digits before occurance delimiter.
e.g. 99-999-9999
2 digits after first ocurance of delimiter -.

This can be achieved by using Switch stage.

This can be achieved by using Substring function.

Sequencer will take care for restartablity. I agree with it. But we really do not want to build additional sequencer for this requirement. We want to keep it between single Unix shell script and multiple Datastage jobs in it.

Our scheduler will call only unix scripts.

My requirement is to call three datastage jobs through a unix shell script. Shell script will call one job after another. But if any job aborts, then during re-run shell script should start running the jobs from point of failure. Example: Shell script is calling Datastae jobs A -> B -> C If A comple...

Try to do data comparision by using iconv functions.

Source File ----> Copy Stage -----> Sort Stage ---> Remove dulicate ---> Target File1
|
|
-----------> Sort Stage ---> Agg Stage ---> Filter ( Count > 1 ) ---> Target File12

In db2 we have db2 -tvf scriptname. But I am not sure about teradata.

You have to set arraysize = 1 L and commit size = 1 L option.

Its dsjob.. You will find lot of posts for the same.