DSXchange

Greg - did you actually monitor the values while you were running your job, not before and then after? I monitored all filesystems on the machine during execution. All of them had many GB left while running (I polled every 15 seconds). I also monitored CPU usage, and memory usage. I noticed that wh...

Thanks for the feedback. Temp /tmp has 20GB free. Resource disk has 60GB free. Another couple thoughts: 1. Is it possible that the server cannot handle generating many dynamic lookup filesets at the same time. In my test case there would be 25 requests within a few seconds. 2. Is it possible that th...

After switching combinability off I get some additional error messages ontop of the buffer errors, node failures, section leader failures. Some of the executions do not have these additional messages. The messages seem to relate to failure in writing virtual datasets used in lookup stages. In this c...

Single machine environment. One node configuration This error occurs when I run several instances of job at the same time (4 or 5). The various instances share no files. I'm going to switch everything to Don't Combine to figure out which stage is complaining. The only network interaction I am aware ...

Of course, if you're doing a lot of repartitioning in an SMP environment, that will also use buffers in shared memory. Are these the buffers you are referring to: 'buffer(4),0: Failure during execution of operator logic.' 'buffer(5),0: Fatal Error: Cannot find protocol entry for tcp protocol!' 'APT...

Hello Forum, What stages or DataStage functionality will use the most shared memory on the server? Even when I am running many jobs my DataStage entry typically shows following: id key Rev Current pid uid Length Used Time created 1 daec7511 0 1 416 0 13689888 86 Aug 21 08:18 The percentage used seem...

Hello Forum, I have the following in shared container: TDApi(TB)-->HashedFile(HF)--> The reference link leaving the shared container is referenced from a transformer in the main job(X). The following is the sequence of messages in the director log showing an error attempting to create the hashed fil...

Hello Forum, If I always want to use the default APT_CONFIG_FILE, and my project environment file has APT_CONFIG_FILE set to default, are there any situations where I will need to specify APT_CONFIG_FILE on the command line, or add APT_CONFIG_FILE as a parameter to my job in order to use the default...

The dynamic metadata functionalities of Ab Initio jobs are far superior to DataStage. I'd recommend sticking with Ab Initio.

The only advantages of migrating to DataStage would be to get a more colorful canvas, reduced licensing cost, and to make use of the dsxchange forum .

- Greg

Hello Forum, Is the number of partitions created in datasets independent of the number of logical nodes in the configuration file? In otherwords, would the following configuration specify 1 or 2 data partitions: { node "node1" { fastname "myfastname" pools "" resource d...

Hello Forum, My Production environment has some differences from development environment: 1) different number of CPUs. 2) different uvconfig settings 3) different $APT config settings 4) different $APT_CONFIG_FILE setup. Let's assume that other than the above list, the environment is the same. Quest...

Thanks to all.

I actually wanted a case sensitive sort anyways, and my job is now working.

- Greg

Hello Ray, Thank you for your feedback. Are you using NLS and, if so, how have you set the COLLATE category in your locale? I do not have NLS installed. You did specify the same sort order (for example col1 = 1, col2 = 2, col3 = 3, all ascending) in both the Sort stage and the Aggregator stage, didn...

Hello Forum, I have a sort stage passing data to an aggregate stage. I am receiving following error for some input datasets. <MYJOB> _Debug3..AggrPickLast: Row out of sequence At row 2, link "FromDenorm" Row out of sequence The sort specifies ascending sort on first 3 columns. My aggregate...

Hello Ray, Thank you for your feedback. I trust you wait for a decent interval between MASTER OFF ALL and shutting down services, as well as making sure no important jobs are running? I guess I originally had thought that shutting down the service would do it's best to make sure that connections to ...