Search found 61 matches

by Xanadu
Tue Aug 17, 2004 11:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and writing to a table in same job..
Replies: 10
Views: 3477

See, this is how your design will work. If array size and transaction size to the table input is 1 every record will immediately get reflected to the reference table. The hash file load will happen only once table A load is completely over. So, just making the array size 1 in the table output link w...
by Xanadu
Tue Aug 17, 2004 11:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and writing to a table in same job..
Replies: 10
Views: 3477

Well this brings to 2 open points.. 1) Since you are working on EPM jobs too..if u notice that the structure i gave u is from those jobs... if u look at my structure again.. the input to the table as array size of 1...but output to the hash file from this table has arrray size of 32767.. so again br...
by Xanadu
Tue Aug 17, 2004 10:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and writing to a table in same job..
Replies: 10
Views: 3477

I would do all of this work in a hash file. Preload it with the rows from the table that you need, or all rows if its size makes sense. --> I cannot preload this..if u notice the table that loads this hash file is being built in the same job that writes this file... Doing it this way also give you t...
by Xanadu
Tue Aug 17, 2004 9:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading and writing to a table in same job..
Replies: 10
Views: 3477

Reading and writing to a table in same job..

Hello... I have a job that writes to a table A.. The setup looks like this: Table A----------------> TFM--------------->Table A ---------> Hash_table_A ---------(ref lookup)----------(writes to A)-----------(writes hash) The transformer does a look up on a table A and writes to Table A. The data fro...
by Xanadu
Fri Aug 13, 2004 9:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM ASCL jobs
Replies: 8
Views: 2401

Keep in mind, though, that most bulk loaders prefer fixed length format files, as does Quality Stage. oops i actually asked u the same question in another thread(adv of char over varchar..)..thanks for answering.. regarding bulk loaders preferring fixed length...I am referring to EPM implementation...
by Xanadu
Fri Aug 13, 2004 9:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Different character collation types across source and produc
Replies: 3
Views: 1510

not during the load but even the staging tables have a different collation type...so this might be a problem during the transformation right ? and also Ray.....one question..is there any particular reason why DWH tables contain char instead of varchar ? thanks Ray It shouldn't be a problem, as you'r...
by Xanadu
Fri Aug 13, 2004 7:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Different character collation types across source and produc
Replies: 3
Views: 1510

Different character collation types across source and produc

I posted this in another EPM specific thread too..but reposting it to hear from others..(i am not sure how many clicked on that thread after seeing that specific subject :) ) Wouldn't it be a problem if character datatypes in source and target follow different collation types ? Is there any advantag...
by Xanadu
Fri Aug 13, 2004 7:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM ASCL jobs
Replies: 8
Views: 2401

Thanks for your posts Him and Brad... Hopefully the site administrators are hearing this... :) Do you have any idea why they use char instead of varchar in staging/production..i dont see any spl adv of using it...i thought DBAs for all practical purposes stopped using char unless its migration from ...
by Xanadu
Fri Aug 13, 2004 7:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM sites using DataStage on this forum...
Replies: 14
Views: 6743

Re: reply of staging jobs

ok ...i am not clear what you mean by "we are using" .. u mean you redesigned the loading of staging tables ? because in the original existing EPM jobs when staging tables are loaded...the table is truncated and all the rows in source are reloaded..the incremental logic is used only in the...
by Xanadu
Thu Aug 12, 2004 8:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM sites using DataStage on this forum...
Replies: 14
Views: 6743

Coool Andy.. Let me tell you .. you will find some really interesting issues in the existing jobs... All the jobs have array size as 32767 and transaction size of 0. i.e. All the 32767 rows are ritten to the database together only once and committed after all millions of rows are written.....hmmm ba...
by Xanadu
Thu Aug 12, 2004 7:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM ASCL jobs
Replies: 8
Views: 2401

PeopleSoft EPM ASCL jobs

* This post is for guyz on Peoplesoft EPM ASCL jobs...Others, please excuse this post* hello all.. I saw a post recently (by Athorne) where some users wanted a special section of the forum for guyz working on Peoplesoft EPM jobs..anything done in this regard.. ? I want to join that section if at all...
by Xanadu
Thu Aug 12, 2004 7:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PeopleSoft EPM sites using DataStage on this forum...
Replies: 14
Views: 6743

Re: PeopleSoft EPM sites using DataStage on this forum...

hi Athorne... nice to know there is another guy working on something similar.. Even i work on customisnig PeopleSoft ASCL jobs.. Good that we can share experiences..ideas.... To start off .....one issue.... Did you notice that the character datatypes in source and target follow different collation t...
by Xanadu
Tue Aug 10, 2004 9:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash lookup Vs. Table look up for smaller volume
Replies: 8
Views: 4454

Hash lookup Vs. Table look up for smaller volume

Hello All, As a rule of thumb I have always avoided reference table lookups..Most of the time I either do a hash lookup or if I am in a mood for some SQL would just use joins (left outer or inner appropriately....) But now I have a question...Data model has a table that would not have more than 20 r...
by Xanadu
Thu Jul 29, 2004 9:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Tables used by a job
Replies: 6
Views: 3239

You can use MANAGER's 'Usage Analysis' (if you didn't alter the columns in your job after loading the columns from 'TABLE DEFINITION' Or as suggested use a script for this (there are a couple 'round this forum) Thanks arier. I used Chuck's tool. The actual issue is that there are a few tables in th...
by Xanadu
Thu Jul 29, 2004 9:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Tables used by a job
Replies: 6
Views: 3239

I have a tool on my site, www.anotheritco.com on the tools page. It list all files and tables used by jobs in a dsx file. You will want to export your job designs (only), copy the export file to your server, and use it as the input file when you run the tool. Please let me know if this help. Thank ...