Issue with Parallel loads with logical nodes
Moderators: chulett, rschirm, roy
Issue with Parallel loads with logical nodes
We have a simple job that uses a direct table to table dump with a Copy stage in between. This is what we did:
- We created 2 logical nodes in the config file and used that config file in the current job
- Added the 2 nodes in the node map constraint field
- Rest of the options are defaults.
When I run this job, the number of records that load in the target is twice of what we have in the source table. If I increase it to 4, then the target has 4 X.
I am new to DS. Can any one tell me what do i need to configure in this case?
Satish
- We created 2 logical nodes in the config file and used that config file in the current job
- Added the 2 nodes in the node map constraint field
- Rest of the options are defaults.
When I run this job, the number of records that load in the target is twice of what we have in the source table. If I increase it to 4, then the target has 4 X.
I am new to DS. Can any one tell me what do i need to configure in this case?
Satish
This is my job design:
Oracle Ent Stage --> Copy --> Seq.File
Oracle Stage:
- have a SQL override with conditions rownum < 50000
- Buffering is default
- Combinability - Auto
- Preserve partition default
Copy Stage:
- Preserve partition propagate
- Auto Partitioning
Seq File:
Default settings
Thanks
Oracle Ent Stage --> Copy --> Seq.File
Oracle Stage:
- have a SQL override with conditions rownum < 50000
- Buffering is default
- Combinability - Auto
- Preserve partition default
Copy Stage:
- Preserve partition propagate
- Auto Partitioning
Seq File:
Default settings
Thanks
-
- Participant
- Posts: 72
- Joined: Wed Dec 12, 2007 2:29 am
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom