DSXchange

Can you clarify what you mean by first and last columns? Do you mean the column values from the first and last records,.... Yes it is the first and last columns but not for the group as a whole but for each key column in the group. I may not be explaining it properly but please look at the example ...

Thanks James. Do you need to know specifically that it's the last record of the group, or just that it's not the first? I need to know that it's not the last record. Using the keyChange column created by a sort stage you can determine whether or not it's the first record (keyChange = 1 is first reco...

Hello, We have a requirement where we need to sort data based on a certain number of columns and then flag the first and last column values of each sort group. As an example the following data is sorted by city, stage and zipcode and the first and last flags for each of the sort column is set: City ...

Yes Craig. Grouping would produce just produce one record for each group. So, I was joining(join keys were the group keys) the output of the aggregator with the original data so that I get the original data (grouped according to the 20 colums) and the count of records in each group. Going back and l...

Hello, We have a requirement where we need to group the input data based on say 20 columns. Let the columns be C1, C2, C3...C20. After grouping, some column values within each group need to compared with the last value for Column 20 in that goup. An aggregator stage can be used for grouping, I beliv...

No SetNull() function used.

Checking the validity before conversion seems to have fixed the problem. So adding before converting seems to work.

Ray,

Yes. I can.

Thanks.

Hello, We have a variable declared as VarChar and we are convering it to an Integer using the following function AsInteger(StringToDecimal(In.Column)) where In.Column is the VarChar variable. We get the following error when we compile: ##I TUTL 000031 18:42:05(001) <main_program> The open files limi...

Thanks for the suggestions Craig.

I need to start looking into invocation ID and related things and might come back with more questions.

We have a parallel job that has five input files and writes to two output files. We are planning to make this job a multiple instance job due to the record count involved. Let us say one of the input files has about 15 millions records. We might run three instances of the same job. My questions are:...

Unique sort and join solves the purpose but as I feared takes quite a bit of time.

Thanks James for your suggestions and I will try them also.

Yes. Unique sort and then join should work but I was looking for ways to avoid using the join stage due to the number of records involved and I also need to repeat the same steps in a number of places and so thought having them stored as global variables might help. I will implement sort and join an...

We have a file and we need to store the distinct values of a particular column. We then need to filter the rows of a second file based on a particular column whose value can be any one of the distinct values stored from the first file. Let us call our files F1 and F2 and columns C1 and C2. We read t...

I will dig deeper into the SAS logic and thanks.

That is true. I guess I need to implement the leap year logic as well. Thanks.