Good ol' sequential file stage warning with a twist!!!!
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am
Good ol' sequential file stage warning with a twist!!!!
Parallel job joining two tables using Join Stage. Data loaded into target ODBC which has a reject link. The rejects are being captured in sequential file.
Preserve Partitioning is cleared in ODBC. Input Partitioning is Round Robin in Sequential Stage...Getting warning
"When checking operator: A sequential operator cannot preserve the partitioning of the parallel data set on input port 0"
I did an exact search and tried all the workarounds. Even cleared the partitioning in the transformer stage preceding the ODBC stage, but to no avail. Pls Help
Preserve Partitioning is cleared in ODBC. Input Partitioning is Round Robin in Sequential Stage...Getting warning
"When checking operator: A sequential operator cannot preserve the partitioning of the parallel data set on input port 0"
I did an exact search and tried all the workarounds. Even cleared the partitioning in the transformer stage preceding the ODBC stage, but to no avail. Pls Help
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am
The warning is there because an operator running in sequential mode cannot preserve the partitioned output of an operator running in parallel mode. It says so in the warning message! Notice that it didn't say "Sequential File Stage"...it said sequential operator. It is talking about the operating mode of an operator."When checking operator: A sequential operator cannot preserve the partitioning of the parallel data set on input port 0"
Which operator is producing the warning (which ones are running sequentially? The job score can show you) You could specify a collection method for the sequentially running operator, or you can use a message handler to take care of the message.
Regards,
- james wiles
All generalizations are false, including this one - Mark Twain.
All generalizations are false, including this one - Mark Twain.
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am
Ok. I had the job in another order in my mind (seqfile -> ODBC).
SInce it's on the reject link of the ODBC stage, run the reject to a Copy stage then to the SeqFile stage. Set the Clear Partitioning option on the output of the Copy stage.
Regards,
SInce it's on the reject link of the ODBC stage, run the reject to a Copy stage then to the SeqFile stage. Set the Clear Partitioning option on the output of the Copy stage.
Regards,
- james wiles
All generalizations are false, including this one - Mark Twain.
All generalizations are false, including this one - Mark Twain.
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 284
- Joined: Fri Oct 13, 2006 4:31 am