I'm reading an sql table and writing the results to a flat file via a sequential stage. The sql query has 'group by' and an 'order by' statements to ensure unique values in the file.
I'm finding that for every unique row I get back from the sql statement, DataStage is writing one for every node we have defined in our /appl/Ascential/....Configurations/default.apt file. In this case, we have 12 nodes in the default.apt file. Therefore I'm getting 11 MORE sets of data in my file than I want!
The file should look like this:
abc
123
def
456
But I'm getting this:
abc
123
def
456
abc
123
def
456
abc
123
def
456
abc
123
def
456
..... etc.
I can't change the default.apt file.
Any help is greatly appreciated!
Cathy
PX creating flat file with duplicate entries
Moderators: chulett, rschirm, roy
-
- Charter Member
- Posts: 18
- Joined: Fri Aug 18, 2006 11:47 pm
- Location: California
Describe the stages in your job. Any chance you set a partitioning to ENTIRE, which sends a full copy of all rows to all nodes, which in turn you write to a sequential file?
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
-
- Charter Member
- Posts: 18
- Joined: Fri Aug 18, 2006 11:47 pm
- Location: California
Glad to be of zero help. Next time, state your stages first. I don't see you mentioning Teradata in your original post, just an unmentioned relational stage and a sequential file.
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
-
- Charter Member
- Posts: 18
- Joined: Fri Aug 18, 2006 11:47 pm
- Location: California
-
- Charter Member
- Posts: 822
- Joined: Sat Sep 17, 2005 5:25 pm
- Location: USA