DSXchange

Does the use of BASIC Transformer in PX job degrade performance or the reverse.

More precisely I should say :

1. Is it possible to have file with metadata (say No. of columns etc) defined at runtime.If yes how.

2. Is it possible to have file with varying metadata. If yes how.

Thanks.

How do we use a BASIC Transformer in PX job. I find there is only one Transformer (called 'Transformer') stage in the Processing pallete.

How do we use a BASIC Transformer in PX job. I find there is only one Transformer (called 'Transformer') stage in the Processing pallete.

How can I create a file whose metadata (No. of columns etc) is known at the run time.
Thanks

Thanks Craig.

When you use 'After-job' subroutine to gather job statistics (like record counts for different links etc),how do you specify the input arguments containing variuos stage and link names (No. of arguments can not be more than two),right?

Thanks Craig.

When you use 'After-job' subroutine to gather job statistics (like record counts for different links etc),how do you specify the input arguments containing variuos stage and link names (No. of arguments can not be more than two),right?

Suppose I have a server routine 'MyServRoutine'(written in DS BASIC) which I want to include in PX job as 'Before-job' or 'After-job' subroutine.Now when I open the Job properties of PX job, I find only the following options in 'Before-job' or 'After-job' : (none) DSJobReport DSSendMail DSWaitForFil...

Writing such routine to calculate the link count is easier in DS Batch.How ever with PX job,I am afraid I can not use such server routine.

Thanks Ray. I appreciate your views. But how to handle situations like this : We are running a no. of jobs in a sequence and data has to be delivered to the target in full or not at all.So, if there is any record drops in between (in either of those jobs) I don't want my data to get delivered to tar...

How do you capture the counts in 'after-job' in Job properties.The procedures listed there do not contain 'DSGetLinkInfo'.

For a trailing generic job (for getting those counts), how can we do that in sequence.

Is there any way so that I can fail a job in case of record rejects.I assume I can do that for Transformer,Lookup stages.But what about stages other like Join,Copy etc.

Thanks.

Will it be cheapest for changing metadata also (like changing column length etc).

Thanks.

Which stage will be the better option to rename a column (to make column names same for Join stage).Thought Transformer may have overhead in terms of performance.

Thanks.

I tried the Horizontal pivot with Pivot stage :

File -> Pivot stage -> File

The job runs successfully but there is no data in output file. I get the following warning in director log :

Pivot_1,0: Info: Test_Pivot.Pivot_1: Cannot map output derivation of column 'Sr_No' to any input column.