DSXchange

You can use a sequential file stage and define you delimiter as a comma. You might also want to check if quotes are required.

Hi Mike, I am having an problem using 3 argument in the isValid function. The derivation box is flagged as red whenever I add the third argument. isValid("date", InLink.DateToValidate) is deemed valid isValid("date", InLink.DateToValidate,"%yyyy%mm%dd") is flagged red i...

Hi, I am currently trying to validate a column in my input file that should contain a date. The date format that I need to validate is as follows: Mar 1 2005 Mar 17 2005 However there are non date entries (3, ABCD) coming in as well and I need to write these invalid records to a reject file. I would...

Hi,

Using a lookup stage might be more appropriate, with the fname,lname file as your input and the fname, email file as you reference link. The bad choice for the key still holds.

Thanks
Abhijit

Hi, Make sure you sort the incoming records on the key prior to the join and it should work. Your problem might be the selection of a bad key column rather the join. The first name might not uniquely identify a row which might result in cross joins. Secondly by selecting an inner join you might be d...

Hi,

I would first sort the incoming records on ID and SEQ. I would then create two variables CurrentID and PrevID in your transformer. If the CurrentID=PrevID Then MSG=MSG:in.MSG Else MSG=in.MSG. The PrevID=CurrentID assignment should the last thing you do in the transformer.

Thanks
Abhijit

Sachin,

If your not manipulating any of the input columns and the only output you need is the row count, why are you using a transformer in the first place? Go with an aggregator instead of the transformer.

Abhijit

The type of join you select depends on what your requirements are. As to an explanation of the options, I would turn to Parallel Developers Guide.

As mentioned above, create a single stage variable (svRejectFlag) and evaluate it based on all the columns that would make it true or false, and apply the constraint on the stage variable.

Hi, We are currently developing parallel jobs for a new data warehouse. The login id we are using in our test environment has DBA equivalent permissions, however our production environment has more limited access (as it should be). The job on test works without any errors but in production it aborts...