DSXchange

Will any one please explain about using the Output Deviation in Pivot Stage


Regards,
Balakrishna

Hi all, I have a requirement of Horizontal pivot i.e c\Columns to Row conversion.The logic to be achieved is explained below i/p: ID COL1 COL2 COL3 COL4 1 10 20 30 40 2 11 25 32 15 3 45 56 23 100 Required O/p: ID CHAR1 CHAR2 1 COL1 10 1 COL2 20 1 COL3 30 1 COL4 40 2 COL1 11 2 COL2 25 2 COL3 32 2 COL...

Thanks to all who gave me the valuable suggestions. As of now i sorted the data in ascending order and after getting the desired output i once again sorted to descending order which is some what time consuming process. If any one tried this logic and achieved the required o/p with descending order o...

yeah one more stage variable is required inorder to perform this operation for each group.

But sainath is there any way to achieve this logic when the data is in descending order of DATE field(i.e the i/p data as i posted in my initial post).

Hi Srinivas,
As you are premium poster,i'm unable to view your entire solution posted


Regards,
Balakrishna

Sainath, I have a solution with stage variables when sorted in ascending order i/p: Col1 Col2 DATE Col4 100 01 2002 15 100 01 2004 30 100 01 2008 24 100 01 2009 33 200 01 1999 10 200 01 2001 12 200 01 2003 20 200 01 2005 45 200 01 2008 21 200 01 2010 50 Stage Variable Utilisation: ------------------...

I doubt whether the stage variables work or not.Here we need to get the value under the DATE column for the next 2 consecutive records to pass to the two new columns.Any other method is highly appreciable.

Sort operation is not required as the data in the input file is going to be in sorted order. Will you please explain the way how the stage variables can be used to achieve the logic.

Forgot to mention.Col4 and Col5 are the newly added column.

Hi all, I have a requirement which is as defined below. i/p: Col1 Col2 DATE Col4 100 01 2009 33 100 01 2008 24 100 01 2004 30 100 01 2002 15 200 01 2010 50 200 01 2008 21 200 01 2005 45 200 01 2003 20 200 01 2001 12 200 01 1999 10 For the above input i need to add two extra columns in such a way tha...

Sainath: "Are you saying that 'select * from table' takes 25 minutes to start !!?? " Balu : Here 25 minutes i mentioned implies the total time required to extract the complete data.In mean time the records are extracted(i.e for 5 minutes some 15 million,10 minutes- 29 million...etc) chulet...

The source table has 80 million data and it has no indexes and client is not ready to create them.

Query looks something like "Select * from table".This Query takes 25 mins for execution and the rest 5-6 mins for the later portion of job execution


Regards,
Balakrishna

Hi Sainath,
My SQL Query is Perfectly tuned.In the above post you have mentioned as "Alternatively you can break into datastage references and joins - if it simplifies and improves ".Will you please through some light on the same.


Regards,
Balakrishna

Hi All, Sorry for the delayed reply Below are my ans in the order wise of the replies given. Sainath: Client and Server are not running on the same PC. ArndW: As i already stated in initial post that source table doesn't have any indexes and client is not intrested in creating the same and has asked...

I have initially checked the job using the Peek Stage as output,but no change in the time taken for job execution.

And no other applications are running in parallel on my PC when i'm running the job and mine is a high configuration one.