Page 1 of 1

Issue with DataStage 9.1 upgrade

Posted: Mon Mar 10, 2014 3:35 am
by DatastageCoEUser
We are working on DataStage upgrade from 8.0.1 to 9.1 version

We are facing the below issues during upgrade

1. Performance issue - parallel engine job startup times taking more time
2. Few Jobs getting hung when parameter APT_NO_BUFFERING_FUNNEL_INPUT=1 is set
3. The sort & remove duplicate (stages) algorithm is behaving differently between 8.0.1 and 9.1
4. Join stage with same input links is behaving differently in DS9.1 (auto partition).
5. Warnings are more in 9.1 compared to 8.0.1 for the same job

Can you please let us know whether we have faced these issue in any upgrade projects?
Also will we face the same issue if we upgrade to 8.5 instead of 9.1??

Posted: Tue Mar 11, 2014 9:52 pm
by asorrell
1. Haven't seen it
2. Never used that option. Why are you turning buffering off on the funnels?
3. Can you quantify "different"? How? What behavior?
4. Again, what is "different"?
5. Most definitely. Starting at 8.1 and again at 8.5 the metadata rules were more strictly enforced, resulting in numerous warnings as jobs are now reporting their metadata doesn't match the metadata on the database. Job should be updated to match. What other types of messages are you seeing?

Null handling did change between 8.0.1 and 9.1 along with some other items which might be causing the join problems among other things.

Refer to this tech note for details on compatibility issues between those releases http://www-01.ibm.com/support/docview.w ... wg21459416

Did you also turn on NLS? If so, there are other issues related to enabling NLS. viewtopic.php?t=151139

Posted: Wed Mar 12, 2014 1:19 am
by ray.wurlod
Have you installed version 9.1.2 (that is, Fix Pack 2)?

Posted: Fri Mar 14, 2014 8:19 pm
by asorrell
Found something that might be pertinent to the slow startup times for PX jobs.

You'll need a valid IBM login id to access this: https://www-304.ibm.com/support/entdocv ... wg1JR49593

Text is below:

JR49593: INFORMATION SERVER 9.1 PARALLEL JOBS HAVE LONG STARTUP TIMES DURING SCHEMA SETUP

Investigation has shown that there is an un-needed function call inside PX schema distribution code which slows down performance on some systems

Status: Open

Posted: Fri Apr 04, 2014 10:12 am
by mandyli
Hi

We had a same issue in our environment 9.1. we are moving from 8.5 to 9.1.

As per IBM we have applied 9.1 patch JR49593 for these issues. The following issue has been fixed 1) slow start-up and 2) sort & remove duplicate (stages) algorithm with Auto partition issues.

Thanks
Man

Posted: Fri Apr 04, 2014 1:09 pm
by mandyli
Again you will hit same issue even 8.5.

We migrated 8.5 to 9.1. It looks like IBM released almost 15 to 20 fixes between 8.5 to 9.1. But we are seeing lot of improvement in 9.1 compare to 8.5.

It looks like you guys using very old version (8.0.1). Better to move 9.1 and also try to redesign some of old jobs which is designed on 8.0.


Thanks

Man

Posted: Fri Apr 04, 2014 2:17 pm
by rkashyap
One issue that we have observed on 9.1.2 (Solaris 64 with windows client) is that at times when the PX Oracle Connector of a readonly job is opened (when another client has job open), it will not show the Connector Properties tab, but reverts to the standard property editor. Similar issue was also observed for Db2Connector, though more severe - DSDesigner crashes.

Our support provider is looking into these issues. Based on what I could gather, few other shops are also facing this issue.

Posted: Tue Nov 11, 2014 12:18 pm
by kmsekhar
asorrell wrote:JR49593: INFORMATION SERVER 9.1 PARALLEL JOBS HAVE LONG STARTUP TIMES DURING SCHEMA SETUP
Hi,

Does the above APAR #JR49593 fix has been fixed as part of new releases i.e., 9.1.2 version or 11.3 version?

Posted: Tue Nov 11, 2014 5:38 pm
by vmcburney
Is number five - more warning messages - due to the use of a message handler that hasn't been migrated between versions? Have a look in the 8.0.1 DataStage Administrator to see if the project has a default message handler that downgrades or hides certain warning messages.

Posted: Wed Nov 12, 2014 1:00 am
by kmsekhar
Hi vmcburney/team

Could you please help me in the below:

Does the above APAR #JR49593 fix has been included as part of new releases i.e., 9.1.2 version or 11.3 version?

Posted: Wed Nov 12, 2014 1:25 am
by chulett
Why not help yourself, ask your official support provider? Get the answer from the horse's mouth, so to speak.

Posted: Wed Nov 12, 2014 1:32 am
by kmsekhar
Hi Chullet,

I've already requested IBM to provide the details, I am yet to get the response.

Meanwhile I thought of getting valuable input from dsxchange team, If you have details please provide.

Posted: Wed Nov 12, 2014 8:07 am
by chulett
If I did, I would.

Posted: Fri Nov 21, 2014 7:05 am
by kmsekhar
JR49593 is NOT in IS 9.1 FP1/FP2, 11.3/11.3.1, It will be included in upcoming version 11.3.2 when it is released