Error while executing parallel job
Moderators: chulett, rschirm, roy
Error while executing parallel job
Hello there,
This is the first time I am executing a Parallel job. I am getting the following error. Can any one help me in correcting the error.
##E TBLD 000000 10:13:57(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 65280
##E TFSR 000019 10:13:57(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 10:13:57(002) <transform> Error when checking composite operator: The number of reject datasets "0"is less than the number of input datasets "1".
##W TBLD 000000 10:13:57(003) <main_program> Error when checking composite operator: Output from subprocess: Couldn't change directory to /export/Conversion/eCommerce/Customer/extracts:/export/Conversion/eCommerce/Customer/logs: : No such file or directory
Thanks in advance.
-Yamini
[/b]
This is the first time I am executing a Parallel job. I am getting the following error. Can any one help me in correcting the error.
##E TBLD 000000 10:13:57(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 65280
##E TFSR 000019 10:13:57(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 10:13:57(002) <transform> Error when checking composite operator: The number of reject datasets "0"is less than the number of input datasets "1".
##W TBLD 000000 10:13:57(003) <main_program> Error when checking composite operator: Output from subprocess: Couldn't change directory to /export/Conversion/eCommerce/Customer/extracts:/export/Conversion/eCommerce/Customer/logs: : No such file or directory
Thanks in advance.
-Yamini
[/b]
-
- Participant
- Posts: 75
- Joined: Tue May 13, 2003 4:14 am
- Location: California
- Contact:
Error while executing parallel job
Hi,
The design of the job is simple.
SEQ ==> Transformer ==> SEQ.
I got the following error:
Output from transformer compilation follows:
##I TFCN 000001 10:11:29(000) <main_program>
DataStage XE Parallel Extender V7.0.1
Copyright (C) 2003, 1997 - 2002 Ascential Software, Inc.
All Rights Reserved
##I TUTL 000031 10:11:29(001) <main_program> The open files limit is 100; raising to 1024.
##I TOSH 000002 10:11:30(000) <main_program> orchgeneral: loaded
##I TOSH 000002 10:11:30(001) <main_program> orchsort: loaded
##I TOSH 000002 10:11:30(002) <main_program> orchstats: loaded
##I TFSC 000001 10:11:30(005) <main_program> APT configuration file: /opt/dsadm/Ascential/DataStage/Configurations/default.apt
##W TFPA 000017 10:11:30(006) <main_program> Warning: the value of the PWD environment variable does not appear to be a synonym for the current working directory. The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system.
##E TBLD 000000 10:11:32(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 65280
##E TFSR 000019 10:11:32(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 10:11:32(002) <transform> Error when checking composite operator: The number of reject datasets "0"is less than the number of input datasets "1".
##W TBLD 000000 10:11:32(003) <main_program> Error when checking composite operator: Output from subprocess: Couldn't change directory to /xxx/yyy/zzz/aaa/bbb:/xxx/yyy/zzz/aaa/logs: : No such file or directory
##I TFCP 000008 10:11:32(004) <transform> Error when checking composite operator: /opt/SUNWspro/bin/CC -KPIC -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -dalign -O -PIC -library=iostream -c
Can you help me in correcting the erros.
Thank you.
-Yamini
The design of the job is simple.
SEQ ==> Transformer ==> SEQ.
I got the following error:
Output from transformer compilation follows:
##I TFCN 000001 10:11:29(000) <main_program>
DataStage XE Parallel Extender V7.0.1
Copyright (C) 2003, 1997 - 2002 Ascential Software, Inc.
All Rights Reserved
##I TUTL 000031 10:11:29(001) <main_program> The open files limit is 100; raising to 1024.
##I TOSH 000002 10:11:30(000) <main_program> orchgeneral: loaded
##I TOSH 000002 10:11:30(001) <main_program> orchsort: loaded
##I TOSH 000002 10:11:30(002) <main_program> orchstats: loaded
##I TFSC 000001 10:11:30(005) <main_program> APT configuration file: /opt/dsadm/Ascential/DataStage/Configurations/default.apt
##W TFPA 000017 10:11:30(006) <main_program> Warning: the value of the PWD environment variable does not appear to be a synonym for the current working directory. The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system.
##E TBLD 000000 10:11:32(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 65280
##E TFSR 000019 10:11:32(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 10:11:32(002) <transform> Error when checking composite operator: The number of reject datasets "0"is less than the number of input datasets "1".
##W TBLD 000000 10:11:32(003) <main_program> Error when checking composite operator: Output from subprocess: Couldn't change directory to /xxx/yyy/zzz/aaa/bbb:/xxx/yyy/zzz/aaa/logs: : No such file or directory
##I TFCP 000008 10:11:32(004) <transform> Error when checking composite operator: /opt/SUNWspro/bin/CC -KPIC -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -dalign -O -PIC -library=iostream -c
Can you help me in correcting the erros.
Thank you.
-Yamini
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Always correct the first error first. In your case, this is the error regarding the PWD environment variable. There is another thread updated as recently as today on this topic.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Behind the scene, when DataStage compile a transformer stage, they actually use your specified C++ compiler.
If your paths are wrong, then your compiler simply will not work, and therefore DataStage will complain and whine like a 6 month old baby without a pacifier.
Fix that PWD error. If the error continues, make sure the provided paths are established correctly as per your UNIX/Linux rules.
Please let us know of your progress on this.
Code: Select all
/opt/SUNWspro/bin/CC -KPIC -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -dalign -O -PIC -library=iostream -c
Fix that PWD error. If the error continues, make sure the provided paths are established correctly as per your UNIX/Linux rules.
Please let us know of your progress on this.
Error while executing parallel job
Hello Man,
We are using Sequential File Stage.
-Yamini
We are using Sequential File Stage.
-Yamini