DSXchange

Also,

sed '1d;$d' filename >> outfilename

will put all the records in filename except the first and last into outfilename.

-BP

Nuts! But, thanks for the info.

I actually have several sequencers with similar "execute command" stages that do work, so I guess it's a hit or miss thing.. I wonder why sometimes the stage works and sometimes it doesn't.

- BP

Tried it.. didn't work. Any other ideas?

-BP

One of my Job sequences has only one stage: an "execute command" stage that calls a script called #pPathNameScrpt#/#pSed#, where both params are defined in the job properties box. This command never executes when I run the sequencer, though the run log shows the correct command being calle...

If all you are doing is reading the file, then 30 GB should be enough. If you're doing any hashing and sorting on the file, I would recommend 2x or 3x your file size for swap space.

- BP

Does the user of PX have permission to execute RSH on all of the nodes?

-BP

Sergey, If you're processing a ton of data, then the more CPUs the better. You will see a marked improvement in performance going from one CPU to four, but you may not see the total improvement that you would like. Sizing your PX job to the best performance is largely a matter of manually increasing...

One of the DS user's machine crashed while he was doing an export. Because of the crash, two of his DS Server Jobs became locked. The DS Admin tried to release the locks by using the 'release job' option in Manager. However, for both jobs the 'release job' option remained greyed out. We were told by...

A PX buildop is a user-defined c program, written in a PX proprietary style, that does record processing and data transformation. To write one, you will need need to use the PX "New Parallel Stage" option in the Tools stage. The PX documentation should have some good examples of how to bui...

It was available in the "import" stage in 6.0. I think the "import" stage was replaced by the sequential file stage in PX, so if the option exists, it should be availabe in the seq file stage.

Can anyone verify this?

BP

I don't think it's easy to get the DB2 error message for rejects from within PX. My suggestion is that you change your design to: input --> transformer --> sequential_file(s). Then outside of datastage, load DB2 and generate the rejects log. Then, in PX or DS, do: rejects_log --> transformer --> DB2...

.. similar to the "performance statistics" availabe for DS Server Jobs.

-BP

I'm wondering if you need consider the partition number when you use @INROWNUM. Another other thing to try:

Collect all your data into a single stream and see if the same conversion logic yeilds the correct results.

I thought PX was being ported to LINUX. If that's happened, you might try to put LINUX on a laptop. Or you could try to cluster 2 linux laptops together. The PX client can sit on any Windows box. It just needs to be able to connect to the server. In that sense, the PX client is mobile. Why are you d...

You can zip your files on output or you could write out a fileset instead of a single file. Writing a fileset is an export option.

-BP