Limit the entry in the log file
Moderators: chulett, rschirm, roy
Limit the entry in the log file
Hi all,
I am loading millions of records into a SQL SERVER table. For each of the rejected record, I get an entry in the log and the log gets filled and creates problems, so I wanted to restrict the number of entries written to the log. Can you please tell me how to restrict this?
Also, I am using a dataset to load the rejeceted records, but rejected records are not captured into the DataSet. When I try to view the records in the DataSet, it says, a new column called, "sqlcode" is present in the dataset which is not present in the table and yes a new column is there.
Can any one clear this?
thanks!
I am loading millions of records into a SQL SERVER table. For each of the rejected record, I get an entry in the log and the log gets filled and creates problems, so I wanted to restrict the number of entries written to the log. Can you please tell me how to restrict this?
Also, I am using a dataset to load the rejeceted records, but rejected records are not captured into the DataSet. When I try to view the records in the DataSet, it says, a new column called, "sqlcode" is present in the dataset which is not present in the table and yes a new column is there.
Can any one clear this?
thanks!
The only correct way is to get rid of the warning message. An alternate way is to demote or ignore the warning message. This can be done with 7.5 PX DataStage for PX jobs. See the directory tab Tools -> Message Handler Environment or look into the DataStage Manager Guide, 14-1 "Ma naging Message Handlers"
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
My mistake I was under the impression, that the sqlcode is propagated only when RPC is turned on. But its not the case.
As mentioned, Copy stage can be used as an intermediate stage to drop the column. By the way, if its reject table, adding Sqlcode as a part of metadata will add more information on what reason, the records got rejected.
As mentioned, Copy stage can be used as an intermediate stage to drop the column. By the way, if its reject table, adding Sqlcode as a part of metadata will add more information on what reason, the records got rejected.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'