Data shuffling in Datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Locked
krishna14
Participant
Posts: 24
Joined: Mon Jan 31, 2011 6:43 pm

Data shuffling in Datastage

Post by krishna14 »

Hey,

I have a situation where i have to shuffle the data for every run ..

and my source id DB2.. target is flat file ..

Please help me out on shuffling the input data in datastage..
krishna
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Generate the SQL query externally and pass it to the DB2 Connector as a job parameter.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
krishna14
Participant
Posts: 24
Joined: Mon Jan 31, 2011 6:43 pm

Post by krishna14 »

can you please elborate & explain the SQL query...Please.
krishna
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Perhaps you can illustrate for us what exactly it is you mean by "shuffling the data" in this context rather than making us guess.
-craig

"You can never have too many knives" -- Logan Nine Fingers
krishna14
Participant
Posts: 24
Joined: Mon Jan 31, 2011 6:43 pm

Post by krishna14 »

Actually my requirement needs different random records for every run of same input DB2 file ,if i can shuffle the data coming from db2 .i would be able to get the random records out of it for every run for the same inout DB2 file..this is my scenario i have to work on ..
krishna
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

How is this any different from your ongoing "Help regarding RANDOM data selecting" post? :?
-craig

"You can never have too many knives" -- Logan Nine Fingers
krishna14
Participant
Posts: 24
Joined: Mon Jan 31, 2011 6:43 pm

Post by krishna14 »

No it is not different ..

actually i got the Random selction of data job done ,but for every run of the job i am able to get the same output random values ....
my criteria needs to get the different Random values for the same input DB2 file.....
krishna
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

That's what I thought, so we'll just lock this one and you can continue the discussion over there.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Locked