Search found 402 matches

by Ultramundane
Fri Nov 11, 2005 2:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate
Replies: 3
Views: 1507

Re: Orchestrate

If you log into ascentials website and go to product documentation under knowledge base, you should be able to download the orchestrate docs.

http://www.ascential.com/eservice/pages ... trate.html
by Ultramundane
Fri Nov 11, 2005 2:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to connect to Server
Replies: 3
Views: 1852

Re: Unable to connect to Server

Can you do a netstat -a | grep -i fin Do you see any connections out there with a finwait2 status? If so, you will have to wait for the no -a | grep tcp_finwait2 value divided by 2 seconds to expire before these connections die and you can restart the service. I set this value to 60 for 30 seconds. ...
by Ultramundane
Fri Nov 11, 2005 12:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Streaming input to external routine to streaming output?
Replies: 1
Views: 953

Re: Streaming input to external routine to streaming output?

I found number 3 to exist already as the column import stage. Still curious about 1 & 2.
by Ultramundane
Fri Nov 11, 2005 12:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Streaming input to external routine to streaming output?
Replies: 1
Views: 953

Streaming input to external routine to streaming output?

I have been using external target, and that works great for outputing the data to a file. But what if I don't want multiple jobs and I want to stream that data to some other routines/stages? I thought I could use the external filter stage, but I must specify the input as being a single column of dat...
by Ultramundane
Fri Nov 11, 2005 9:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating Multiple rows in output from single row in input
Replies: 16
Views: 5007

Can you use an external target stage to write to a delimited sequential file? Can you use awk? If so, I think this awk tidbit might do the trick. #!/bin/ksh FNAME="${1}" AFS="${2}" awk -vAFS="${AFS}" -vFNAME="${FNAME}" 'BEGIN{FS=AFS;OFS=AFS;} { COUNT=1; while ...
by Ultramundane
Wed Nov 09, 2005 12:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Columns to Rows
Replies: 6
Views: 2345

Re: Columns to Rows

I entered your data and I came up with this query. I hope someone can come up with a better answer for you. This query might not run well on your database and if you do run it, you may want your DBA (if not yourself) to validate indexes exist for this query. SELECT K1.NBR, K1.SEQ, (SELECT MAX(K2.EVN...
by Ultramundane
Wed Nov 09, 2005 7:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filter stage and dynamic file creation
Replies: 4
Views: 2144

awk will keep track of what files it has used/opened. Once awk is stated, any new file used/opened will be overwritten the first time. Any file re-used after that will be appended.

Basically, > is the same thing as
>
followed by
>>

in a normal shell script.

Thanks,
Ryan
by Ultramundane
Tue Nov 08, 2005 6:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12910

I am trying to load balance the network IO across multiple network interfaces that are on the same AIX SMP server. I put my APT_CONFIG_FILE in a previous post. Please look at the file and offer any suggestions. I would be happy with round robin approach. That is, one config file for this network int...
by Ultramundane
Tue Nov 08, 2005 3:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filter stage and dynamic file creation
Replies: 4
Views: 2144

Could you use an external target stage for your job? You could create a shell script similar to the one below. It will create a file for each distinct value of $1 (the first field), named $1.file. #!/bin/ksh AFS="${1}" DIR="${2}" awk -vAFS="${AFS}" -vDIR="${DIR}&qu...
by Ultramundane
Tue Nov 08, 2005 2:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Forcefully disconnect a user/kill a process?
Replies: 2
Views: 1479

Will do. Thanks for your feedback.
by Ultramundane
Tue Nov 08, 2005 2:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12910

I do. It is the same server. The interfaces rcrpdev1a and rcrpdev1b are two different interfaces into the same server.
by Ultramundane
Tue Nov 08, 2005 12:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12910

I believe I have tried that, but jobs abort with these messages: main_program: Accept timed out retries = 8 main_program: The section leader on rcrpdev1b died main_program: **** Parallel startup failed **** This is usually due to a configuration error, such as not having the Orchestrate install dire...
by Ultramundane
Tue Nov 08, 2005 11:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Forcefully disconnect a user/kill a process?
Replies: 2
Views: 1479

Forcefully disconnect a user/kill a process?

What is the best way to forcefully disconnect/terminate a user process? kill -15, then kill -9 on user processes? Just shutdown the server and wait for tcp_finwait2 time? I have tcp_finwait set at 60 so after 30 seconds AIX will terminate the network connections and the service can be restarted. You...
by Ultramundane
Tue Nov 08, 2005 8:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Columns to Rows
Replies: 6
Views: 2345

Re: Columns to Rows

Can you have your database engine do the work? SELECT K1.NBR, K1.SEQ, ( SELECT MAX(EVNT_EFCTV_DT) FROM Kav K2 WHERE K1.NBR= K2.NBR AND K1.SEQ = K2.SEQ AND K2.EVNT_CD = 3800 ) AS "DT1", ( SELECT MAX(EVNT_EFCTV_DT) FROM Kav K3 WHERE K1.NBR= K3.NBR AND K1.SEQ = K3.SEQ AND K3.EVNT_CD = 6000 ) ...
by Ultramundane
Mon Nov 07, 2005 12:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: why this fatal won't abort a job???
Replies: 10
Views: 4484

You can set ulimit for a shell and inherited shells will have the new ulimit. That is, you could set it in your profile, logout and login, then bounce datastage. cat ~/.profile ## DATASTAGE PROFILE unset ENV ## DATA ulimit -d 1048576 ## MEMORY ulimit -m 1048576 ## NOFILES ulimit -n 10000 ## STACK ul...