Folder Stage problem
Moderators: chulett, rschirm, roy
I remember doing this and realizing that it needed everything in a single large column. ...so I concatenated all the values together, row after row, followed by CRLFs, and then used an aggregator to get the "last" value for each key (each "city").
The output derivation stays red, but works: (simple example but should give you the idea)...
outputLink.wholeLine : inputLink.myColumn : char(13) : char(10)
If you send this to a sequential stage, you'll see it grow in a cascading sort of fashion...
row1
row1 row2
row1 row2 row3
etc.
...aggregate it in another downstream stage by the key and get take the last value.....
...send those sorted rows (one per key) into the Folder Stage.
Ernie
The output derivation stays red, but works: (simple example but should give you the idea)...
outputLink.wholeLine : inputLink.myColumn : char(13) : char(10)
If you send this to a sequential stage, you'll see it grow in a cascading sort of fashion...
row1
row1 row2
row1 row2 row3
etc.
...aggregate it in another downstream stage by the key and get take the last value.....
...send those sorted rows (one per key) into the Folder Stage.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
-
- Premium Member
- Posts: 120
- Joined: Thu Oct 28, 2004 4:24 pm
Not quite sure what you are trying to do, but I would take and use a sf > transformer > and three seq files as out put. put a constraint on the first column to divert the records to the appropriate file a.txt,b.txt,c.txt.
I don't know why you are using a folder stage. a folder stage is used to read numerous files within a folder and process the data in each file.
the record definition for this is
filename <varchar(100)
record <LongVarChar(999999)
I don't know why you are using a folder stage. a folder stage is used to read numerous files within a folder and process the data in each file.
the record definition for this is
filename <varchar(100)
record <LongVarChar(999999)
"Don't let the bull between you and the fence"
Thanks
Gregg J Knight
"Never Never Never Quit"
Winston Churchill
Thanks
Gregg J Knight
"Never Never Never Quit"
Winston Churchill