Use of combine records stage
Moderators: chulett, rschirm, roy
Use of combine records stage
Hi
I am trying to use a combine record stage Please let me know how to use or give me an example what exactly wht it does
Thanks in advance
I am trying to use a combine record stage Please let me know how to use or give me an example what exactly wht it does
Thanks in advance
dsguy - this site is staffed by unpaid volunteers, the premium memberships help defray the costs of running this site.
Since posters have a choice of which questions to respond to, you have the best chances of receiving help if your post details exactly what your problem is and what you've tried to address that issue.
I read the following into your question:
a) You haven't looked into the Parallel Job Developer's Guide or the on-line help.
b) You haven't experimented in trying to get this stage to work.
Thus my thought processes are pretty simple - if the poster hasn't put much effort into the problem, why should I?
Perhaps I am mistaken, in that case please accept my apologies, reply and post what you've tried and what doesn't work and I'm sure you'll get some assistance.
Since posters have a choice of which questions to respond to, you have the best chances of receiving help if your post details exactly what your problem is and what you've tried to address that issue.
I read the following into your question:
a) You haven't looked into the Parallel Job Developer's Guide or the on-line help.
b) You haven't experimented in trying to get this stage to work.
Thus my thought processes are pretty simple - if the poster hasn't put much effort into the problem, why should I?
Perhaps I am mistaken, in that case please accept my apologies, reply and post what you've tried and what doesn't work and I'm sure you'll get some assistance.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Hi ArndW
Sorry for the delay in my reply
I am currently working in DataSate PX 7.5.I have never got a chance to use combine records,make subrecords,make vector,promote surecord, split subrecord,split vector and i am not sure when to use these stages to get an understanding i am executing ther jobs using this stages.
It tried to get understand the same from the guide but no ware an example is given so i can understand it and I tried to work on it and job was aborting,
Sorry if I have not given enough inputs .
Thanks & Regards
Sorry for the delay in my reply
I am currently working in DataSate PX 7.5.I have never got a chance to use combine records,make subrecords,make vector,promote surecord, split subrecord,split vector and i am not sure when to use these stages to get an understanding i am executing ther jobs using this stages.
It tried to get understand the same from the guide but no ware an example is given so i can understand it and I tried to work on it and job was aborting,
Sorry if I have not given enough inputs .
Thanks & Regards
dsguy - I apologize for my earlier post about assuming you hadn't tried anything.
What was your error message when you tried this?
What was your error message when you tried this?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Hi AndeW
Thanks for you time and your reply.
Actually what i assume a combine records stage does is for the same key column it combines the records.
For example
Input OutPut
CLCL_ID NAME CLCL_ID Name
1 A 1 ABC
1 B
1 C
Please let me knwo if my assumption is wrong
Please find the error which is encountered
1)sequential_File_67: Error when checking operator: Input "NAME" is not a value field.
2)Combine_Records_70: When checking operator: The modify operator keeps field "CLCL_ID" which is not present in the output interface.
Please let me now how to proceed on this
Thanks ,
dsguy
Thanks for you time and your reply.
Actually what i assume a combine records stage does is for the same key column it combines the records.
For example
Input OutPut
CLCL_ID NAME CLCL_ID Name
1 A 1 ABC
1 B
1 C
Please let me knwo if my assumption is wrong
Please find the error which is encountered
1)sequential_File_67: Error when checking operator: Input "NAME" is not a value field.
2)Combine_Records_70: When checking operator: The modify operator keeps field "CLCL_ID" which is not present in the output interface.
Please let me now how to proceed on this
Thanks ,
dsguy
Start with the sequential file error. Do you have a column called NAME and can you view data or read the file without the combine records stage?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Are you declaring your combine stage output schema or using RCP? I just created a test job with 3 columns and combined without any problems.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Even i got the same error message when i tried to write the combined record (assuming which is a vector) to seq file. but when i replaced sequential file with a dataset the job ran fine, but when i tried viewing the data from dataset i all i could see wasray.wurlod wrote:Please post the record schema from both the input and output links of your Combine Records stage. ...
[() ()]
[() () () () () () () () () () () () ()]
[() () () () () () () () () () () () ()]
[() () () () () () () () () () () () () () () () () () () () () ()]
how do i convert to readable form so that my next job can do the processing on this.
Regards
Narendar
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The generated OSH for the Combine sub records stage isray.wurlod wrote:That's not the record schema. The record schema can be obtained from the generated OSH (in job properties, if enabled) or from the score. ...
#################################################################
#### STAGE: Combine_Records_72
## Operator
aggtorec
## Operator options
-subrecname 'text'
-key 'SUBM_I'
## General options
[ident('Combine_Records_72'); jobmon_ident('Combine_Records_72')]
## Inputs
0< 'Sequential_File_65:DSLink68.v'
## Outputs
0> [modify (
keep
text;
)] 'Combine_Records_72:DSLink69.v'
;
#################################################################
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The Input Record schema isray.wurlod wrote:That's the stage OSH, not the record schemas. Record schemas begin with -record and contain column definitions enclosed in a pair of curly braces. ...
(
Key:int32 {quote=none};
A:string[max=255];
B:string[max=255];
C:string[max=255];
D:int32 {quote=none};
E:nullable int32;
)
And i used Key as the key in Combine Subrecords stage