loading of 100 dBase IV files into a single fact table, in a

Archive of postings to DataStageUsers@Oliver.com. This forum intended only as a reference and cannot be posted to.

Moderators: chulett, rschirm

Locked
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

loading of 100 dBase IV files into a single fact table, in a

Post by admin »

This is a topic for an orphaned message.
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

If the table definitions are different for different tables, it cant be done in a single job. You *may* be able to do it with job control, or you may like to investigate the job control API which allows you (in DS 4.1 and later) to create jobs "on the fly" - but it is complex and you need a client language such as Visual Basic.
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Ray has a point.

I just reread your message. If I understand correctly, these 100 dbase files are all different? This is really no different to reading from 100 different tables in a relational database. Perhaps you could clarify this for us.

What I was referring to in my earlier message is that I read many (sometimes
hundreds) of dBase files that all have the SAME column definitions.

You might want to think about writing an extract in dBase or FoxPro to transfer it all to a single file that DataStage can load.

Alternatively, you could probably write it all in DataStage Basic. Calling ODBC directly from code allows you to interrogate what the row looks like. At the very least, due to the typeless nature of variables in Basic, it wont be so sensitive to the type of the source columns. However, if you havent written DataStage basic programs before, this is probably a bit ambitious.


-----Original Message-----
From: Vivek Pandey. [mailto:vive@sonata-software.com]
Sent: Tuesday, 10 July 2001 4:36 PM
To: datastage-users@oliver.com
Subject: loading of 100 dBase IV files into a single fact table, in a single job

Dear All,
I have to load about 100 dBase IV file into a single fact table, how can I achieve it in a single job. This has been a problem, since extraction of dBase IV files require an ODBC stage, and the column derivation has information about the specific dBASE file. Has anyone every tried this, is there any alternative way



Regards,

Vivek Pandey _______________________________________________________
Consultant - Business Intelligence
SONATA SOFTWARE LTD.
193, R.V. Road,
Basavangudi,
Bangalore - 560004 INDIA
Voice: 91-80-6567492/6/7, 6561063/4/7, 6562068, 6568495
Cell: 91-98450-24394
Fax: 91-80-6567487
Web: http://www.sonata-software.com
Alt. email:viv_pan@usa.net _______________________________________________________
Locked