Datastage job got stuck when extracting data from SQL SERVER

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What's different between the two environments? Hint: "nothing" is not the correct answer.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rakesh311
Participant
Posts: 36
Joined: Wed Aug 04, 2010 10:53 pm
Location: Banglore
Contact:

Post by Rakesh311 »

Its not NOTHING :wink: ..Both SQL SERVER environments have differences.

Below are those differences
DEV:

OS:-WINDOWS 2003
Number of CPU -2


Stage :

OS- Microsoft Windows Server 2008 Enterprise
Number of CPU-8
rAKESH
boxtoby
Premium Member
Premium Member
Posts: 138
Joined: Mon Mar 13, 2006 5:11 pm
Location: UK

Post by boxtoby »

Hi,

I think we need to know a bit more about what is going on here:

I assume the job is hanging after extracting data from the database using one of the database connect stages. If so, does the sql statement perform well when run from the SQL Server IDE?

What sort of volumes are being returned between dev and stage?

What is the job doing? Has it got many other stages? For example, it might be waiting for a look up link to complete somewhere else in the job.

Is the stage you are referring to a source feed or look up feed?

If the volumes are high, as you say, are look ups done with join stages?

Cheers,
Bob.
Bob Oxtoby
FranklinE
Premium Member
Premium Member
Posts: 739
Joined: Tue Nov 25, 2008 2:19 pm
Location: Malvern, PA

Post by FranklinE »

There's not much to go on, but check my topic at viewtopic.php?t=151911 in case it might help.
Franklin Evans
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson

Using mainframe data FAQ: viewtopic.php?t=143596 Using CFF FAQ: viewtopic.php?t=157872
crystal_pup
Participant
Posts: 62
Joined: Thu Feb 08, 2007 6:01 am
Location: Pune

Post by crystal_pup »

Try reducing the Array Size value to 1
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Are you sure it is getting locked on update? Are you using (NOLOCK) on your extracts? Could be locking on extract. If not then are you updating more than one row?
Mamu Kim
Rakesh311
Participant
Posts: 36
Joined: Wed Aug 04, 2010 10:53 pm
Location: Banglore
Contact:

Post by Rakesh311 »

We were getting ASYNCHRONOUS_NETWORK_IO lock SQL server.

After Working with IBM,Microsoft, Network Team we resolved the issue.
This is due to some "Advanced" network setting of Microsoft Windows Server 2008.

This is what we done

1. In the Property list, click TCP/IP Offload, click Disable in the Value list, and then click OK.
2. In the Property list, click Large Send Offload, click Disable in the Value list, and then click OK.
3. Disable other Offload properties for IPV4

Now things are working fine


Thankyou everyone !!
rAKESH
Post Reply