DSXchange

Say I have three different type of aggregations to be done Aggr1 = Groupkey1,Groupkey2,Groupkey3, Aggr2 = Groupkey1,Groupkey2,Groupkey3,Groupkey4 Aggr3 = Groupkey1,Groupkey2,Groupkey3,Groupkey4,Groupkey5 Option 1: Sort1 [GK1,GK2,GK3], Aggregate1 using GK1-3 Sort2 [GK1,GK2,GK3,GK4], Aggregate2 using ...

You can specify the constraints for all the output links then for the last link check mark as the reject. Or specify the constraints and someone will set it up for you. Sam Say reject criteria is Cond 1 OR [Cond 2 And Cond3]=Reject output For any other conditions other than the reject criteria, I n...

Hi, I have this question. I have an input to transformer, and I want to reject few coming in based on few criteria, and the rest would be deviated thru various output links based on various constraints..How do i go about it. The REST are those that don't match the criteria for the rejects. Thanks Vi...

Just wondering what APT stands for in all those APT_*** ??

narasimha wrote:Select the Aggregate Function to be "Count"

But in the same aggregator, I need few columns to be Calculated, and other column to be Row-Counted, and this isn't permitted !?!?

Hi, First should thank all the suggestion for my previous questions. I have an alternate method of arriving at the no of rows used, but my question is : In an Aggregator stage, is there a way to count the no of rows? e..g, if it's Grouped by A/C Nr and there are 10 records for this A/C No, I would l...

The test you made for Dataset to sequential file, dose it have the same input and output directories of you normal jobs has? As Arnd suggested, maintain 'Same' partiton on all the stages as possilbe (neglect the warning for the case study). Kumar, Yes the Datasets and seq file have the same input a...

Hi I am having hard-time grasping this RCP concept. Reading manual, and going thru the forum, only made my case worse. In a nutshell can anyone point out from the Best Practice Manual, when and where RCP is to be turned ON/OFF.. Sorry, for posting this question, but as I mentioned, manual, and the f...

ArndW wrote:What stage are you writing to in this job? Perhaps the dataset is repartitioning to match the output and therefore is taking longer. ...

I have Dataset as Input, passed thru Transformer, Filter, SORT and Aggregator and finally funnelled thru to an output Dataset

ArndW wrote:How many nodes in your configuration file? Do the data files reside on the same disk volume as your sequential file? ...

Thanks.
[1] 4 Nodes and
[2] NO - Datasets and Sequential file reside in different mountpoints[but on the same disk volume]

Hi, Here's a scenario. Designed a job with Seq file as input and job runs in a minute Now getting the Input as Dataset and so changed Seq File to Dataset, and it takes 20minutes. [PS: I tried a simple job, copying Dataset to Seq file, thinking reading the dataset is taking long, but it ran in few se...

What algorithm are you using in the Generator property? All you have to do is use a Cycle and specify it as the correct number of spaces. But you do have to configure each generated column separatel ... Thanks Ray...That's how I did atleast to some of the columns generated [Type=Cycle and Value=&qu...

In all sorts you can specify a Null Value Position so that nulls sort at the beginning or at the end. There is no capacity when sorting to effect a transformation; the only stages that do this are Mo ... Thanks Ray...I had taken care of this before, but couldn't remember on where to handle the NULL...

Hi, I have few SORT columns defined as NULLABLE and in certain cases, for some records, these SORT columns are set to NULL [just to ensure, these are sorted way down]. Where should I go about [Job, Designer, Manger ??] defining the property for NULL to be HIGH-VALUE or so...I'm totally blind-folded ...

Hi,
I'm using Column Generator to generate few columns, but I want to Initialize those fields [SPACES]. Is there a simple way to have all the generated columns initialized [rather than going column by column and initializing it] ??
Thanks in advance
Vijay