Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
nk_bastia
Participant
Posts: 7 Joined: Fri May 26, 2006 12:18 pm
Post
by nk_bastia » Wed Aug 19, 2009 3:49 am
I need to update flat file of 4GB without using database.
Design Structure like:
Source is Flat file
Target is flat file.
Lookup is flat file.
Please suggest.
Sainath.Srinivasan
Participant
Posts: 3337 Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom
Post
by Sainath.Srinivasan » Wed Aug 19, 2009 4:04 am
Update what ?
You have provided no information for others to assist in any way.
Provide your full requirement and design.
Who said you cannot use any database ?
ArndW
Participant
Posts: 16318 Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Post
by ArndW » Wed Aug 19, 2009 4:21 am
Bear in mind that flat files cannot normally be "updated" in the sense of replacing line nn with another value.
Sainath.Srinivasan
Participant
Posts: 3337 Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom
Post
by Sainath.Srinivasan » Wed Aug 19, 2009 4:32 am
But you can simulate an update or use other mechanisms to make it happen.
ArndW
Participant
Posts: 16318 Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Post
by ArndW » Wed Aug 19, 2009 4:35 am
Sainath, sure - that's what text editors and other applications do. But I think that the OP might imagine one could "update" records in a flat file via DataStage PX jobs and that won't work.
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Wed Aug 19, 2009 7:32 am
Exactly - they will need to write the changes out a new (updated) version of the flat file and then perhaps rename the new name back to the old name.
-craig
"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Wed Aug 19, 2009 6:25 pm
You can always "pretend" by using an ODBC driver for text files.
This is an excellent solution if you're billing by the hour!
(It is likely to be very slow on large files.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
dsedi
Participant
Posts: 220 Joined: Wed Jun 02, 2004 12:38 am
Post
by dsedi » Thu Aug 20, 2009 4:05 pm
may be OP is asking about "File Update Mode"(Create/Append/Overwrite)