Issue with Dataset stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
anajitKS
Premium Member
Premium Member
Posts: 28
Joined: Thu Dec 18, 2014 7:57 pm
Location: Kansas City

Issue with Dataset stage

Post by anajitKS »

We have a job which is supposed to source data from a SQL Server table and create one Sequential file and one Dataset stage.

Job runs fine if we do not include the Dataset Stage.
If we include it keeps on running and the performance statistics shows that it is not pulling any data from the source.

The program runs fine in development. But we are having the problem in production environment. Apparently, I did not find any difference in environment setup.

Any help on this will be appreciated.
ABHIJIT DUTTA
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

That is strange. As of now I cannot think of any reason it would happen. What is the longest amount of time you have let the job run? Does it eventually complete or give any errors or warnings? Can you do a test job #2 to read the file and write to a Data Set OK, or does it have the same problem?
Choose a job you love, and you will never have to work a day in your life. - Confucius
anajitKS
Premium Member
Premium Member
Posts: 28
Joined: Thu Dec 18, 2014 7:57 pm
Location: Kansas City

Post by anajitKS »

We have tried to make a second job and run it. We had the same issue.
ABHIJIT DUTTA
samyamkrishna
Premium Member
Premium Member
Posts: 258
Joined: Tue Jul 04, 2006 10:35 pm
Location: Toronto

Post by samyamkrishna »

Have you tried a job with just a row generator writing into a dataset.
then another job reading that dataset into a peek.

Is this the only job that uses dataset in your project.
what about other jobs.

has this been happening only now or has it been happening from a long time.(begining of this datastage environment)
Cheers,
Samyam
anajitKS
Premium Member
Premium Member
Posts: 28
Joined: Thu Dec 18, 2014 7:57 pm
Location: Kansas City

Post by anajitKS »

This was the only job that is using dataset stage. but it ran so many times before.

One question, what kind of configuratuion, I need to have to make dataset stage work. If I know that, So, I can look for the existence of that component.
ABHIJIT DUTTA
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

Look at your APT file.

Go look at the "resource disk" settings. Ensure that the paths are valid, the space is sufficient and you have read/write authority to them.
anajitKS
Premium Member
Premium Member
Posts: 28
Joined: Thu Dec 18, 2014 7:57 pm
Location: Kansas City

Post by anajitKS »

I checked everything looks fine.

But it still does not work.
ABHIJIT DUTTA
samyamkrishna
Premium Member
Premium Member
Posts: 258
Joined: Tue Jul 04, 2006 10:35 pm
Location: Toronto

Post by samyamkrishna »

did you try creating a new job.

Code: Select all

rowgenerator---------10rows--------->dataset
if this doesn't work. Then there is an issue for sure.
Cheers,
Samyam
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

And you are saying that if you switch out the dataset stage to a PEEK stage or Seq File stage, the job runs fine?!?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What error/warning messages were logged?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
John Corbin
Premium Member
Premium Member
Posts: 12
Joined: Fri Jun 13, 2008 2:51 pm

Post by John Corbin »

Moved my post to separate topic
Last edited by John Corbin on Fri Jan 01, 2016 9:48 am, edited 1 time in total.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Are you using any unbounded string data types (Char or VarChar)?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply