View Data doesn't show all requested rows
Moderators: chulett, rschirm, roy
View Data doesn't show all requested rows
My datastage has been acting weird of late. I'm wondering if anybody else has run into something similar.
I have a Flow that reads in numerous data tables via ODBC and puts them into their own data sets on the hard drive. I noticed that when I do a View Data now on a data set stage, a table which has 112 rows of data only gives me the first 30. I have the prompt specified for View Data to show the first 250 rows, and no skip or anything.
I took the one of these out and put it into its own flow. Same thing happened. So i replaced the data set stage with a sequential one to output to a CSV file. Same thing happened. I went to the hard drive, opened it with a text editor, and it showed 112 records.
I tried restarting the services and that did not work. Anybody run into this before?
I have a Flow that reads in numerous data tables via ODBC and puts them into their own data sets on the hard drive. I noticed that when I do a View Data now on a data set stage, a table which has 112 rows of data only gives me the first 30. I have the prompt specified for View Data to show the first 250 rows, and no skip or anything.
I took the one of these out and put it into its own flow. Same thing happened. So i replaced the data set stage with a sequential one to output to a CSV file. Same thing happened. I went to the hard drive, opened it with a text editor, and it showed 112 records.
I tried restarting the services and that did not work. Anybody run into this before?
I had thought of that too because it's definitely happened to me before. Here was my line of "thinking" and action I took:chulett wrote:Only when there is a metadata mismatch between the viewing stage and the actual data. Any chance there's "something wrong" with the rows that don't show up when you compare the column definitions to the actual data?
1) Imported ODBC definitions again from the database.
2) Made a brand new flow with ODBC Stage (with the new definitions) --> Dataset
3) Compile/Run
4) Told me 112 rows got inserted into the Dataset
5) Checked DataStage Director and saw no warnings or errors.
6) "View Data" and only the first 30 of 112 rows showed up.
7) Made a similar flow, except the output was a sequential file instead of a dataset.
8) Compile/Run
9) Check sequential file via View Data, same result. Check it on the file system, saw 112 rows.
10) As a result, I made a new flow where the sequential file which shows 112 rows of data is input, output to another file, but has a reject link. 0 rows of data went to the reject link, and 112 rows passed.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I think this ultimately ended up being the reason. Thanks. I opened the sequential file in a hex editor and noticed a 1A (in Hex) character in a field in the 30th record (and also other places).ray.wurlod wrote:Is there a Ctrl-Z character in your data? (This is the Windows end-of-file marker.) ...
Thanks again.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: