Dataset vs Sequential file
Moderators: chulett, rschirm, roy
Dataset vs Sequential file
I am creating a dataset in 1 job, that is being brought into another job, but it isn't giving me static results.
However, when I use a sequential file, the data is as expected.
Why the difference?
Thanks
However, when I use a sequential file, the data is as expected.
Why the difference?
Thanks
-
- Participant
- Posts: 24
- Joined: Fri Oct 01, 2004 1:43 pm
- Location: USA
Re: Dataset vs Sequential file
I've done this several times with no problem. Can you be more specific on what is different in this case between the two runs?
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I also had this problem. when the working with the Dataset and the sequential file in the same job. After running the job, when I saw the data, it was all NULLs . Any one knows the reason. I remember reading from a sequential file and putting in a dataset. and the dataset contains nulls where expected some values.
Thanks[/quote]
Thanks[/quote]
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The default in a Sequential File stage is to report a zero-length string ("")as NULL. You can override this behaviour in the properties. Null field value property in parallel, NULL value property in server.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
But the nulls were displayed in Dataset stage and that too for all the records (not few records where the values are defaulted as you said). Instead of dataset, I used sequential file stage at the end. I got the values expected. Any idea why this is. Any problem with the dataset while uploading the data from sequential file.
Thanks,
Thanks,
this is a bug
Hello, thanks to all for answering my original post. My problem all along is due to a bug. I just found this out from Ascential. Below is the description from Ascential.
The fix for the problem was something that required fixes in many different
modules (That is why it could not be back ported to 7.0). For this reason, I
can't get a detailed description of all the parts of the code that were
fixed. Here is the description from engineering of what the exact problem
was:
The modify operator has a feature where it will do a block copy of some kind
instead of a field by field copy in certain circumstances. But, there is
(was) a bug in cases where real numbers in the input were equal to null.
Some of the non-null fields in the input were being set to null in the
output.
Since this was a problem with the block copy and not the dataset stage
itself, the bug effected other stages as well (It was originally reported
with the copy stage).
The fix for the problem was something that required fixes in many different
modules (That is why it could not be back ported to 7.0). For this reason, I
can't get a detailed description of all the parts of the code that were
fixed. Here is the description from engineering of what the exact problem
was:
The modify operator has a feature where it will do a block copy of some kind
instead of a field by field copy in certain circumstances. But, there is
(was) a bug in cases where real numbers in the input were equal to null.
Some of the non-null fields in the input were being set to null in the
output.
Since this was a problem with the block copy and not the dataset stage
itself, the bug effected other stages as well (It was originally reported
with the copy stage).