Merge 240 flat-files into one and then process using DataSta
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 1255
- Joined: Wed Feb 02, 2005 11:54 am
- Location: United States of America
Merge 240 flat-files into one and then process using DataSta
Hi Gurus,
I have 240 flat-files, each having the same number of fields (15). The files are located on a Windows Box (on a network). The DataStage 7.5.1 server and clients are on a windows box as well.
How do I merge these 240 files? I need to transform after merging these files. If I use a Merge Stage (Do we have merge stage in 7.5.1 Server job or is it called row-merger?), does it create any performance issues? If so, is there any other way of tackling this?. Any suggestion or advice is tremendously appreciated.
Thanks in Advance,
Naveen.
I have 240 flat-files, each having the same number of fields (15). The files are located on a Windows Box (on a network). The DataStage 7.5.1 server and clients are on a windows box as well.
How do I merge these 240 files? I need to transform after merging these files. If I use a Merge Stage (Do we have merge stage in 7.5.1 Server job or is it called row-merger?), does it create any performance issues? If so, is there any other way of tackling this?. Any suggestion or advice is tremendously appreciated.
Thanks in Advance,
Naveen.
-
- Premium Member
- Posts: 1255
- Joined: Wed Feb 02, 2005 11:54 am
- Location: United States of America
Thank you Craig and ArndW. Say if I have three flat-files, ff1.txt, ff2.txt and ff3.txt in the "Merge" folder of the C drive.
Will the command look something like this?
Where should I execute this command in windows?
Thanks again,
Naveen.
Will the command look something like this?
Code: Select all
C:\Merge\*.txt >> output.txt
Thanks again,
Naveen.
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Try not to have the target file in the same folder as the source files.
Or simply speccify type c:\merge\*.txt as the filter in a Sequential File stage.
Code: Select all
type c:\merge\*.txt > c:\temp\outfile.txt
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
-
- Premium Member
- Posts: 1255
- Joined: Wed Feb 02, 2005 11:54 am
- Location: United States of America
-
- Participant
- Posts: 145
- Joined: Fri May 02, 2003 9:59 am
- Location: Seattle, Washington. USA
I am not to sure if you found the actual command that you want. The correct syntax is:naveendronavalli wrote:Thanks a lot!
Ray, ds_user78, ArndW, chulett and Sainath.
Naveen.
Code: Select all
copy c:\merge\*.txt /a c:\temp\combofile.txt /a
Shawn Ramsey
"It is a mistake to think you can solve any major problems just with potatoes."
-- Douglas Adams
"It is a mistake to think you can solve any major problems just with potatoes."
-- Douglas Adams
-
- Premium Member
- Posts: 1255
- Joined: Wed Feb 02, 2005 11:54 am
- Location: United States of America