Which is the better File Format
Moderators: chulett, rschirm, roy
Which is the better File Format
Hi ,
Which is the preffered or better File Format for Files . Is it Fixed Width or Delimited ..??
Which is the preffered or better File Format for Files . Is it Fixed Width or Delimited ..??
It is like asking which is the better vehicle - a Porsche or a Chevy van. The answer will depend upon what you want to do with it.
Fixed width files are great for parallel processing (finding the 100th line is a simple matter of mutiplying line length times rows). This quick direct access is not possible with variable length files. Delimited files are smaller since there is no padding done and, as bart as already noted, they are easier to read manually.
Fixed width files are great for parallel processing (finding the 100th line is a simple matter of mutiplying line length times rows). This quick direct access is not possible with variable length files. Delimited files are smaller since there is no padding done and, as bart as already noted, they are easier to read manually.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Premium Member
- Posts: 783
- Joined: Mon Jan 16, 2006 10:17 pm
- Location: Sydney, Australia
The one which work better for the condition.
Last edited by keshav0307 on Wed Jul 29, 2009 8:19 pm, edited 1 time in total.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I have no idea what "codition" means. Can you please clarify this term, ideally with a reference to a dictionary website or similar?keshav0307 wrote:The one which work better for the codition.
Meanwhile, from a perfomance perspective (and depending absolutely on how good the programmer is) I would prefer fixed width, because extracting/replacing fields is a simple substring (memory move) activity, whereas a delimited format necessitates a scan counting delimiters.
As a "hint" DataStage "remembers" the most recently encountered delimiter where the delimiters are @FM but not otherwise.
Ultimately, though, the best - and only - format for source files is the one that is right for the files "they" send to you.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 783
- Joined: Mon Jan 16, 2006 10:17 pm
- Location: Sydney, Australia
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 783
- Joined: Mon Jan 16, 2006 10:17 pm
- Location: Sydney, Australia