Search found 17 matches

by StuM
Fri Jun 01, 2007 10:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

It is an SQL Server database. I spoke to our DBA about it and they suggested that the tables were not efficiently designed. The odd thing is that it was running fine, but recently performance has gone bad - the use of the server recently has increased 8-fold, this must have had a detrimental impact....
by StuM
Fri Jun 01, 2007 2:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

Thanks, that is a useful technique to bear in mind for future. In this case I do indeed have a seperate job to extract from the tables, so can eliminate the idea of 'back pressure'

Back to the drawing board, I need more coffee... :lol:

Cheers,
StuM
by StuM
Thu May 31, 2007 9:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

Hi again, I think I misunderstood your reply DSguru2B. Basically, I have a requirement that at any one time the table will hold the latest data for a number of rows. Each day when the suite is run, I am updating the table where the row exists, inserting new rows and leaving well alone rows which hav...
by StuM
Thu May 31, 2007 7:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

Thanks DSguru2B - I will replace the ODBC stage with a write to a DataSet and see how we go.

Cheers,
StuM

[edited to correct who it was addressed to!)
by StuM
Wed May 30, 2007 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

Thanks Ray, I will give that a go. Strangely enough, our retrieval from the tables is now displaying similar levels of poor performance.

Cheers,
Stu
by StuM
Thu May 24, 2007 7:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fluctuating Performance from Enterprise ODBC stage
Replies: 9
Views: 2995

Fluctuating Performance from Enterprise ODBC stage

Hi All, I am suffering performance issues with the EE ODBC stage that I hope you might be able to help me out with. I have had a search, but couldn't find the solution. Basically, we have several (Parallel) jobs that run sequentially, each of them loading up either sequential files or datasets to MS...
by StuM
Fri Aug 11, 2006 9:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error when trying to read a fixed width file - EE
Replies: 5
Views: 2220

Now make sure you parse the last column correctly(since you know the length of the last-but one column) so that you get your output correct. :wink: Thanks, will do. Found the culprit - the file is a concatenation of multiple files, each with there own header. I (wrongly) thought that all of these h...
by StuM
Fri Aug 11, 2006 9:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error when trying to read a fixed width file - EE
Replies: 5
Views: 2220

Hi Kris,

I made the changes that you suggested to the table definition and... it worked! Time to have another look at the data I guess!

TGI Friday :lol:

Thanks very much for your time.

Regards
Stu
by StuM
Fri Aug 11, 2006 9:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error when trying to read a fixed width file - EE
Replies: 5
Views: 2220

Error when trying to read a fixed width file - EE

Hi All, I am trying to read a fixed width file into a sequential file stage of a Parallel job. I set up the format as: Record Length=Fixed I have set up the column definitions with multiple fields, all character and of various lengths. I have double checked and the input file is the same length as t...
by StuM
Tue May 23, 2006 9:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Output Link - how to amend
Replies: 9
Views: 2565

Brilliant! Thanks for your help Ashwin, I will modify it accordingly.

Kind regards
StuM
by StuM
Tue May 23, 2006 9:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Output Link - how to amend
Replies: 9
Views: 2565

ashwin141 wrote:Are you trying to do this in PX or Server?
In PX...

Thanks
StuM
by StuM
Tue May 23, 2006 9:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Output Link - how to amend
Replies: 9
Views: 2565

Try chaging the link type or check the reject option. Your problem is still not clear. Thanks. Basically the job functions are: * Read in a sequential file * Use a transform to split: 1. Header to another transform, which converts the format and writes out to a sequential file. 2. Data to a sequent...
by StuM
Tue May 23, 2006 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Output Link - how to amend
Replies: 9
Views: 2565

Reject Output Link - how to amend

Hi All, I have a relatively simple job and part of it is to take two sequential files and put through a funnel to combine them. They have different attributes on input, so I wanted to set the output columns to a single fixed width field (the same for both files) and then put through the funnel. Howe...
by StuM
Sat May 20, 2006 6:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting MM/DD/YY date to DD/MM/YYYY in EE
Replies: 6
Views: 2426

Great, thanks very much for your help.

Regards
StuM
by StuM
Fri May 19, 2006 8:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting MM/DD/YY date to DD/MM/YYYY in EE
Replies: 6
Views: 2426

Thanks again - use of %year_cutoffyy achieved the desired result.

Could anyone tell me how this works. I am using %2000yy. What theoretically will happen in 2100?

Thanks in advance.
StuM