DSXchange

Ray

But I don't see any information screen like you said, it just ask if I want to overwrite existing component or not in case of I did not check "overwrite without query" (with or without check "perform impact analysis").

What about using only one job activity after extract job, which is another sequence job but this job will run multiple jobs at the same time(2 independent stream).

Just my idea, not test yet.

When you import dsx file, there is an option to perform impact analysis.
But after tested many times I don't see any difference whether I choose it or not(import existing/non-exist component).

What does it really use for?

I understand that if I set APT_NO_SORT_INSERTION to True would solve this problem. But actually this is not my concern. The point is I want to know if I leave job design as default (auto partitioning,auto insert sort), the job performance would be as good as manual partitioning and sorting at every ...

@BI_RMA I think ds0 and ds 1 has the same definitions ( seq file stage -> sort stage) ds0: {op0[1p] (sequential Sequential_File_1) eOther(APT_HashPartitioner { key={ value=KeyCol, subArgs={ asc } } })<>eCollectAny op2[2p] (parallel APT_CombinedOperatorController(0):Sort_1)} ds1: {op1[1p] (sequential...

It's my intention to have auto inserted tsort operator and auto partitioning just for test this case.
The question stay the same, is datastage smart enough to check that data is already sorted on desired field and do nothing or it have to re-sort all data again?

If data have been sorted (Sort Stage) and then DataStage auto inserted tsort operator (Join Stage - same key as Sort Stage), is it actually re-sort data again? I've created test job like this Seq_1 ---> Sort_1 ---> Copy_1 ---> Join_Stage --->Copy_3 Seq_2 ---> Sort_2 ---> Copy_2 ---^ Some of job scor...

Is there a way to encrypt/hide custom rule sets in Designer? (For prevent copy)
But all jobs that use this rule set can still executable.

I read the document about these two methods but still I don't understand the difference.

Can someone explain the difference with some example?

Thank you.

Sorry,for best I mean fastest.

What is the best method for update table on non-indexed columns (where condition on indexed column? If the table has about 100 million records which is the best method? 1. Datasets -> DB Stage using upsert command. 2. Datasets -> DB Stage using Load command then using SQL update join in the next job...

Since the option in reference match stage are many to one and one to one.
Is there a way to do many to many match for multiple pass?