DSXchange

I have encountered this problem in past when I didn't have my data sorted before aggregation.. Larry, sorting data is always efficient before aggregation, and there is column available in Aggregator Stage where you specify how the data is sorted.. Now geeting back to the problem, as you tried sortin...

But amitava, first you need to read the file before you apply any NullHandling function.

Is it a user defined query ? If so pls make sure your metadata match with the column order in your select query.

What are you trying to achieve, One column to many columns ??

Or One column to many rows ???

And Pivot is used in Server...

Wait a sec...do you mean three rows ???? and not columns

If thats the case then look at Pivot Stage....

Sorry, if I misinterpreted your question.

Look at Field function provided there is a delimiter (, in your example) as you shown in the example.

Col 1 Col 1 2 3
A,B,C A B C

If you rejects those records in transformer then you can avoid these warnings. Stop them from going to the DB stage.

Hi Yaminids,

Its the other way round. The number of columns in the file is less that columns defined in stage.

Just look at that record and you should get the answer to your question.

Someone in operation should know the Max length possible..there has to be a limit. Why don't you ask them ?

Please look into the documents..its explained there.

Even I have noticed that starnge behaviour in past, not sure what the reason is. But from what I was able to conclude is that, it happens when you move that data between trasformers somehow that empty string is treated as null. Try running nulltoempty routine, in the last xformer....and you will see...

In the Sequential File Stage, within the column properties....you can specify whether that column contains the line terminator.

Once you read the file successfully..you can use the convert function to convert the line terminator into space or some other character.

You can use that as a parameter, and assign the value through a afterjob routine.
This afterjob routine will check the status of your job, and based on the status it will set the value of that parameter to p or e.

HTH

Hi Sainath,

What i meant by head and tail is to move the data (w/o empty records) to another file..provided he knows the position of empty records.

Where are these empty lines..you can use head, tail or sed commands in unix...for removing those extra records.