Hi
I am aggregating about 30 million records and get the "row out of sequence" error even though it's in sorted order. Input is seq file.Input is already sorted and the order is mentioned in AGG.
Job desgin is...Input seq file(with filter command to sort the record passing to Aggregator and output seq file). I even removed the filter command and sorted it seprately. but facing the same problem.
When it encounter the second record in the following example it throws the error. Data Type is defined as BIGINT in aggregator.
89843731,x,x,x,x,x,x
241146165,x,x,x,x,x,
When I changed the data type to INTEGER it worked fine.
Does anyone know the reason ?
Thanks
Row out of sequence when it's in order ?
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
No idea at all. BigInt and Int are treated as the same in DataStage BASIC. Is any of the values larger than 2^31-1 (which might cause an arithmetic overflow in an Int data type)?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Quick question, Ray:
If he treats it as a VARCHAR, aren't the numbers going to be ordered lexically as opposed to numerically. To me, it seems that is what the original example looks like.
Bestest!
If he treats it as a VARCHAR, aren't the numbers going to be ordered lexically as opposed to numerically. To me, it seems that is what the original example looks like.
Bestest!
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
Great! Thanks for the clarification Craig. That makes perfect sense because as long as the target field is numeric, then the leading zeroes would just drop off during datatype conversion.
Bestest!
Bestest!
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"