Hi All,
Can I have a sequential file whose input is from 3 different sources and the output of the sequential file pointing to a single file ?
For example the input has three different links and the output being a single file
Thanks,
Shyju.
Regarding Sequential file
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 84
- Joined: Thu Dec 04, 2003 9:55 pm
Hi Shyju,
As Kumar stated earlier u can only one Input link from the Seq Stage,
If you have teh same meta data and u have source data coming form different sources on to common location of the same type you could use Folder Stage, Where u need to set some parameters this will take the multiple I/P files processe and send to one input file or You could concatenate the files before the process starts and run the job.
Hope the above helps.
Advance New Year wishes.
With Regards
Mahesh
As Kumar stated earlier u can only one Input link from the Seq Stage,
If you have teh same meta data and u have source data coming form different sources on to common location of the same type you could use Folder Stage, Where u need to set some parameters this will take the multiple I/P files processe and send to one input file or You could concatenate the files before the process starts and run the job.
Hope the above helps.
Advance New Year wishes.
With Regards
Mahesh
The Stage icon allows multiple input and output links, but each link has its own filename associated to it.
To have multiple links combine their owns in to a single stream, use the link collector stage.
If you attempt to have multiple output links write to the same file simultaneously, you will end up with corrupt output data because all operating systems write data in blocks, there is no concept of a "row".
To have multiple links combine their owns in to a single stream, use the link collector stage.
If you attempt to have multiple output links write to the same file simultaneously, you will end up with corrupt output data because all operating systems write data in blocks, there is no concept of a "row".
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Hi,
Can't help thinking what happened to the filter command option?!
you can use it to say have a:
/usr/bin/cat #PATH#/file*
as the data source instead of the conventional file name.
IHTH,
Can't help thinking what happened to the filter command option?!
you can use it to say have a:
/usr/bin/cat #PATH#/file*
as the data source instead of the conventional file name.
IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Craig,
I stand corrected, by answering to fast an answer with to short a description.
I ment you can write to 3 files (not always you can use link colector) if you want to avoid syncronising your 3 writes.
Then concatenate the files using a command stage or reading the 3 files on your next job with the filter command.
I guess I was thinking to far ahead
Then again the poster never gave info regarding what they want to do with the target file.
I don't know what crystal ball I was looking at while answering
I guess the poster might reply, so I can mark that ball as dammaged or extra-ordiner.
P.S.
If you read it again (witout the example) you might understand why I understood it differently and assumed a filter might be handy.
I stand corrected, by answering to fast an answer with to short a description.
I ment you can write to 3 files (not always you can use link colector) if you want to avoid syncronising your 3 writes.
Then concatenate the files using a command stage or reading the 3 files on your next job with the filter command.
I guess I was thinking to far ahead
Then again the poster never gave info regarding what they want to do with the target file.
I don't know what crystal ball I was looking at while answering
I guess the poster might reply, so I can mark that ball as dammaged or extra-ordiner.
P.S.
If you read it again (witout the example) you might understand why I understood it differently and assumed a filter might be handy.
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org