DSXchange

'0001' was just an example. In his case, there are values greater than and less than that the constant number. So sorting might not actually work for him. I think this is taken care by defining the flag column. So in any case the duplicate record with '0001' will be flagged as 1 and will appear as ...

'0001' was just an example. In his case, there are values greater than and less than that the constant number. So sorting might not actually work for him.

Nope. You have to define your dummy column in a way that you can identify the values you need drop when they have duplicates. I guess the tricky part here is to define that dummy column with a value when there are duplicates on '0001' . May be you can pull out an extra link from source where the no...

"Your best bet is to build a quick web interface that allows the user to load their file to a specific spot (with a specific static name) on the system. Then you can kick off a DataStage sequence or job to process the data. " Our approach is that users will upload the files into UI and as...

Hi, Requirement : My client's requirement is that users will give us certain input files in an ad hoc manner and the ETL tool is supposed to load those files Solution: The proposed solution is that we will build an User Interface using .Net or HTML and give the privileges to users to upload the file...

How to delete a dataset permanently? I believe i could be done using data management. Not sure though..
Kindly help me

Hi, If A->B->C... and P-->Q-->R... are two totaly independent streams of jobs, then create two separate sequencers for them. Code for error handling and add check points in each sequencer and schedule them as two separate jobs at the same time, so that they run parallely. Creating a master sequence,...

Agree with Kirtikumar completely. I should have said "Join stage requires both of its input datasets to be key partitioned and sorted". Hash key partition ensures, the same keys are in one partition and are not scattered across. This would ensure a correct join. Sorted data would make thin...

May be you should just do, what the error says!!
Set the PWD variable from the Administrator-->Environmentvariables-->Userdefined.
Set the value of PWD to your project folder which will be like c:\Ascential\Datastage\Projects\projectname.

Let us know if it works!!

I think join stage does sorting implicitly Join stage does require both of its input datasets to be in sorted order for a correct output dataset. However the default partitioning method which is "AUTO" ensures that sorting is done on both the input links to the stage. It is worthwile to n...

What partitioning is best for transformer and what is the default one? "Auto" partitioning is the default and in my opinion it is the best, unless you have a specific data scenario, which may warrant other partitioning methods. When I sort the data in database stage and for some conversio...

If you are using 'Minimum value' on the Activation_date column, and the datatype is BigInt, make sure the date format is 'YYYYMMDD'. Also make sure the datatype/format of the column 'Activation_date' is same on both the input links to the Join stage. The join may fail if both are in different formats.

One possibility is that, your other link to the join stage is not hash partitioned or sorted. Because of which, the keys are ending up in different partitions and not getting matched!!

If I use the BASIC Transformer in my PX jobs ,does that mean then I'll lose the parallelism within the job ? IMHO, By using a BASIC Transformer, you wont lose the parallelism. The BASIC transformer stage will be simply run as those no.of instances as the no.of nodes. Folks, correct me if i am missi...

When you use the partitioning type "same" , the hash partitioning performed in the first job is preserved. i.e. the dataset used in the second job also has the same hash partitioning on custid. But when you perform hash partitioning on the acctid in the second job, the records are dropped....