Waves with Hierarchical Stages
Posted: Mon Aug 01, 2016 2:52 pm
We took a perfectly fine working job that uses hierarchical stage to parse transactions. We broke it by adding a Wave Generator stage in an attempt to get the Hierarchical stage to parse a single file at a time rather than an entire batch of 5000 files.
Our favorite error is currently: Xfm_EOM_Group,0: Failure during execution of operator logic.
Xfm_EOM_Group is the name of a transform following a funnel stage. This transform adds some default values and calculates a row number. The output goes to another Hierarchical stage that composes an XML file that is landed on a drive.
Our favorite error is currently: Xfm_EOM_Group,0: Failure during execution of operator logic.
Xfm_EOM_Group is the name of a transform following a funnel stage. This transform adds some default values and calculates a row number. The output goes to another Hierarchical stage that composes an XML file that is landed on a drive.