Reading excel file using Unstructured data stage
Moderators: chulett, rschirm, roy
Reading excel file using Unstructured data stage
Hi All,
I used "Unstructured Data" stage to read from an excel file. It ran perfectly fine for the first time. I got another file to load and when I ran the same job, it hangs everytime after loading 30,000 records (this file has a little more than 32K records).
I tried to debug the problem but could not identify the issue. File does not seem to have any issues, as I could load this file successfully into my table.
My job just loads data from excel into a table.
Any help on what could be possible problem or how to debug it will be really helpful.
Thanks in advance.
Regards,
PR
I used "Unstructured Data" stage to read from an excel file. It ran perfectly fine for the first time. I got another file to load and when I ran the same job, it hangs everytime after loading 30,000 records (this file has a little more than 32K records).
I tried to debug the problem but could not identify the issue. File does not seem to have any issues, as I could load this file successfully into my table.
My job just loads data from excel into a table.
Any help on what could be possible problem or how to debug it will be really helpful.
Thanks in advance.
Regards,
PR
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You may also want to involve your DBA when it 'hangs' to see if there are any issues on the database side, blocking locks and the like. Does it still hang if you run it on a single node? Assuming there are multiple nodes (>1) at the moment.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
I recall having had issues with large data volumes and the Unstructured data stage. The Java engine uses a lot of memory, you might try setting the environment variable:
to increase the heap to 512 from the default 256. If the job still hangs in the same place after this change you can be sure that isn't due to Java space; but I have a suspicion that it might be cause.
Code: Select all
CC_UNST_JAVA_HEAP=512
I don't have 9.1, though my thought is also about the nodes. Rather than change the nodes, if that stage have the option to make is as Sequential change it, may help some time!chulett wrote:Okay... how about the nodes question?
Try to read using server job will also give some idea.
Thanks
Ram
----------------------------------
Revealing your ignorance is fine, because you get a chance to learn.
Ram
----------------------------------
Revealing your ignorance is fine, because you get a chance to learn.