DSXchange

Thanks guys for the replies. I had forgotten about my post for the last couple of days but please see below for the solution that seems to work. I used the UserVariables Activity to initialize the Year and Month User Variables as below: Year = OCONV(@DATE,"DY") Month = OCONV(@DATE,"DM...

The correct syntax is paramerr = DSSetParam (qsales_handle, "quarter", "1") . Thus, I changd my code to: ErrCode = DSSetParam(ParallelJob_handle, "Year", "2011") But, still the parameters in the parallel job are not set. I guess I am missing the big picture he...

I am trying to implement what Ray suggested here but looks like I am missing a lot things. I have a server job and in the Job Control tab of the server Job Properties, I have the following code ErrCode = DSSetParam(ParallelJob, "Year", "2011") where ParallelJob is the name of the...

On a related note, if the key columns from either input files to the Join Stage are nullable, is it best to have the corresponding input file as a sequential file rather than a data set?

Thanks.

Sura, [quote]Try to recreate the dataset again with the key column and try it again. I misread your suggestion yesterday. So, when creating the dataset, I changed the key column name to the column name that would be used in the joiner. I read the dataset again and use it in the joiner and it works f...

That makes a lot of sense now. I was able to view them using cat, more, less and so the integers were stored as character representations.

Thanks for the help.

I must also add this. The column 'TRAVEL_ID' is stored under a different name when writing to the data set. When I again read the data set, I read the corresponding column to 'TRAVEL_ID'. I did the same renaming when reading the sequential file and the joiner worked fine. I also tried reading the da...

Hello, I used a Join Stage to join two sequential files based on a common column and it worked fine. One of the sequential files was replaced by a data set and loaded with the same data (same column names and data types, length) but now I get the following error when the job is run: subArgs={asc}}}:...

Removing the quotes option from the Field Defaults category on the Format tab in the sequential file stage fixed the problem. James, I believe the integers were stored as integer but were enclosed in strings. How do you check the hex code of the file? I believe looking at the hex code gives you the ...

By 'this", I meant enclosing the nullable column using the NullToEmpty() transform.

Thanks for the help.

Enclosing the nullable column using the NullToEmpty() transform before concatenation seems to have fixed the problem.
Is this the most efficient method of implementing this?

Thanks for the help.

I was looking into the thread below: http://www.dsxchange.com/viewtopic.php?t=119708 The input is sorted based on 15 keys and I was trying to implement the following transformer logic suggested by Chulett: svCurrGroup derivation = KEY1 : KEY2: ...KEY15 svIsNewGroup derivation = svCurrGroup <> svPrev...

What is the best method of avoiding the conversion to strings? I ran into a similar situation where we perform a join on an integer column present in two sequential files and and the column was converted to string in the ouput sequential file.

Thanks.

We are making use of sequential files. So the data flow is:

Sequential file---> Transformer---> Sequential file.

If the input file has 10 columns, the output file has 11 columns with a new column added in the Transformer stage.

We have an integer value as input in one of the columns. We declare a new column as an integer in the Transformer stage and perform some basic if-then-else logic on the incoming integer column and store an integer in the newly declared interger column of the Transformer stage. The problem is this in...