DSXchange

No...but I've seen scenarios where a Business Term is associated with a particular table (sometimes in a category that is established for such types of Terms) and then that Term has custom attributes. ...another way would be to have an Extension Mapping with custom attributes and map that Extension...

I always use FastTrack...I find it best because it can remove everything from the Host on down..... ...but in 8.1.2 you can use Workbench (list the objects from the main page using the listing options on the right), or you can use the new option for repository mgmt in the Info Server Web Console. ....

Hi folks, we had a couple of shared tables created in DataStage as a test. I removed them. They are still in Metadata Workbench and Business Glossary. Is there a way to remove them?

Thanks,
Doug

Hi folks, looks like Metadata Workbench has a few predefined attributes for tables and their columns from DataStage. For example, columns have the following default attributes in Workbench: Column Definition Name Description Business Term Data Steward Type Imported from Data Item Defines DataStage C...

When I read, I get approx 4000 row/sec. from a dataset. When I read from Oracle, I get 30000 rows/sec. Hi just ran some tests here. I have a table with 180 byte rows. Reading 10M rows into dev/null from Oracle runs at 50K rows/sec. Reading 10M rows from a dataset into dev/null runs at 170K rows per...

chulett wrote:That behaviour is specific to datasets, AFAIK. ...

Based on testing and using df -h in the scratch area while the job runs, it appears that this applies to the scratch area too. I think it follows then that this also applies to memory.

Thanks,
Doug

Hi folks, the answer to this question seems to be that DataStage will require the full upper bound for each varchar if the upper bound (the varchar size) is specified in the column definitions. If you remove the varchar sizes from the metadata, then DataStage will only consume what the actual data r...

chulett wrote:You marked your post as using the UNIX system for your server, hence the confusion. ...

Actually I marked my post as using the UNIX system for our server, because we are. Raftsman is just here stirring up trouble

ray.wurlod wrote:I would be interested to know what that "elsewhere" is.

Forum on IBM. No big deal.

Hi folks, I've seen elsewhere that Varchar(N) are always exactly N+4 bytes when in a dataset. varchar/char(N) with NLS will always be 2N (+4 for varchar). But I am wondering what the memory and scratch footprint is. Is it the same as above, or is it variable? At the time of this post, a search on &q...

I have been experimenting with datasets and I have found that using a DBMS is more efficient that using them. Our environment uses Oracle and I am using TMP Oracle datasets as a holding area. The R/W process is much faster. If datasets are your only option, I think your going to have performance is...

Hi folks, we have a brand new system, and I building my first job. Our system was sized with only 45GB available for DataSets. Our old custom PL-SQL process transfers about 1TB of data every night. Seems to me if I am thinking about landing data in DataSets I will immediately overrun my 45GB. So I h...

Hi folks thanks for your thoughtful answers. From the information presented so far, I think there are several possibilities: 1) There really aren't best practices. It's a term that describes lessons learned, but everyone has an opinion, and there are so many, and so many various use cases, it's poin...

Hi folks, not coming from a DataStage or ETL background, and having just begun to architect a DataStage system, I am wondering... does anyone use best practices? Can they be used here? Have any been defined? If you answer yes to this poll, perhaps you can lend some insight into what your answer means.

Thanks Ernie, not to quibble, but I see this as very much aligned with the principles of SOA. But perhaps the term is now so loaded with Web Services connotations that I shouldn't use it. I admit to authoring a provocative subject line. :) Thanks for your feedback, and yes I think a dataset is an ar...