Unable to migrate data from unidata to oracle

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Unable to migrate data from unidata to oracle

Post by Vaibhav »

Hi,

I would like to upload the data from Unidata Database to Oracle. Here when I open the data from Datastage job, it is showing few records say 5 or 6 records while it is showing all the records say 10,000+ records in the Unidata database. I must admit that there is one column in this table. While running the job data is not getting uploaded. This is the same case with all the tables which are having one column. Here column is ID and it is primary key.

How to resolve this ?

Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi ,

Please help me in this reagrd , its needs to be delivered urgently.

Thanks in advance.
Vaibhav Malhotra,

Software Engineer
Noida,India
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Vaibhav,

Immediate help costs money, this is a volunteer site. If you have a contract with Ascential or a service provider you might get help there.

Your problem description was vague, which is probably why you haven't gotten a response. And since you specified "urgent" it reminded me that I need to go home.

If you were to attempt debugging your problem a bit more and specifying exactly what isn't working as expected you might get an answer.
ketfos
Participant
Posts: 562
Joined: Mon May 03, 2004 8:58 pm
Location: san francisco
Contact:

Post by ketfos »

Hi,
Did you try moving data from Unidata to a sequential file?

Ketfos
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Try creating a synonym for @ID in the UniData file dictionary, maybe called ID, and use that in the UniData stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi ,

When I try to view data in unidata stage ,I am able to view only 10 records.
Whereas in unidata there are 4060 records in this table.

Any suggestion as to why am not able to view other records ???

Further this table has only one column that too ID and its is not multi valued .

Ray - I am using ID in the unidata stage .


Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I you write your job to read the data and write it straight to a sequential file with no modifications or other stages, does it do more than the 10 records you see in "view data"? Are there any warnings or errors in the log file for that run?
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi Arnd,

Unidata is my repository db.
I need to extract data from here and migrate it to oracle db .

In the first stage itself....i.e unidata stage : I am able to view only 10 records ....whereas the table contains 4060 records.

I ma unable to understand as to why I am not able to view further records.

This is not a multivalued column .

Further I am not getting any warning messages too.

Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Please, I understood your question the first 2 times.

Sometimes "View Data" works differently than when you run a job. Right now you are stating that when you view data in the job designer you only get 10 rows. I am asking that you write your data to a sequential file and RUN the job to see if it still shows only 10 records. If not, the issue is within the designer's view data, if not then we can look elsewhere.

Also, did you perhaps specify a "selection" in that tab?
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi Arnd,

As suggested by you I used the sequential file between the unidata stage and transformer stage.

I am able to view only 10 records in sequential file (after running the job).

Please suggest .

Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

1. Please check to make sure that you are not doing a SELECT in your unidata stage
2. Can you connect to unidata and do a COUNT on that file? Also list the whole file to make sure that it is not broken.
3. Can you select & view another file completely - i.e. is this limited to the one file or to some or all files?
4. Are the 10 keys you do see different or "special" compared to the rest of the file?

5. (should be at position 2). Add BY clause to change your result order. Do you still get 10 and are they a different 10?
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi

Answer to point 1-

I am not doing select in unidata stage.

Answer to point 2-
Connecting unidata through REFLECTION.

The count from unidata db is 4060 .
( select count(*) from table_name )

If I do select * from tablename i am able to view data .


Answer to point 3-

There is no problem with other tables.

Answer to question 4--
10 keys are like this :
1898
5101
201
4904
7071
2057


Thre are no special characters.


Answer to question no 5-

Position is 0


Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

By (5) I didn't mean a position in the columns, but just the order to test. Can you add a sort and see if you get the same keys in the same order, the 10 original keys sorted, or 10 ascending keys not in your original list.
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Hi ,

I am not getting the same sequence by doing order by.

Reason being the ID 's sqltype is VARCHAR.

Regads,
Vaibhav Malhotra,

Software Engineer
Noida,India
Vaibhav
Participant
Posts: 17
Joined: Tue Sep 06, 2005 11:46 am
Location: Noida

Post by Vaibhav »

Also its not in ascending order...

1
1000
1001
1002
101


Regards,
Vaibhav Malhotra,

Software Engineer
Noida,India
Post Reply