DSXchange

Have you tried using XMLSpy or other tool to help you verify the structure?

The XML Input stage would handle the XML parsing into rows and columns, based on the Xpath declarations in the description field. Remember that the stage needs to find all the begin and end tags in the proper order, so make sure you're working with well-formed XML (XMLSpy is a good tool).

Jay, You've stumbled on that great debate over using custom routines vs configuring the tool to perform the proper action. Using the tool capabilities will better insure that your jobs will work on future releases of DS. Your custom routines, while very fast, may cause havoc on a future release. For...

If you are on release 7.5, you can use the project environment variables to store your usernames and encrypted passwords, and have them flow seamlessly into the jobs. You would need to update each job, but it might give you better flexibility and security in the long run. The encryption in the proje...

If you only need the 15-byte key, why not write just that field to the sequential file? Your performance should always be better with the sequential file output rather than the hash file. It also seems that your sequential file output becomes the input to a downstream job. If this is the case, then ...

I'm getting this same error about once a day for the past week on my 7.5 client with windows server. I haven't tried to re-install the client yet, since it hasn't affected me much. I'll try the reinstall. Thanks for the tip Craig.

Alan

Problem resolved:

I've been able to trace the problem back to the BW side and have corrected a permissions issue with the target cubes. The named pipe message did not turn out to be an error but just informational.

Thanks,
Alan

I get an error message in the RFC connection log on the DS server when executing a DataStage job from SAP BW to pull data into BW: I: Keyname DSJob I: Keyvalue MCDMSubmItemL045 I: Keyname $jp_BWConnection I: Keyvalue I: Keyname $jp_MCDMInFilePath I: Keyvalue I: Keyname $jp_MCDMOutFilePath I: Keyvalu...

Bring up DS Administrator, choose any project, choose command. Type in CONFIG ALL and execute. All your .uvconfig values will be displayed.

Also, CONFIG BRIEF shows just your license info, CONFIG DATA shows your tunables.

HTH

You may want to look at the External Filter stage. Be aware that some of these stages require the data to move via stdin/stdout. Another alternative is to just let the header and trailer records fall out the rejects link of the Sequential File stage, since the metadata probably won't match that of t...

I've done this before, but with variable number of rows per unique key column. First the key columns must be sorted. Next, an empty row must be added to the end of the input data. I use an after-stage ExecSH routine to append the extra line. This line will be used as your final break. You'll need to...

Are you planning on setting up failover for each of the servers in the MPP cluster or just the main server where DS jobs are initiated? Does the proposed failover seamlessly migrate IP address/host names? The configuration file identifies the nodes, hosts, disk pools, etc. I'd suggest you look at yo...

Shawn's approach (adding the CRC value to the target table) would work great, especially with a large target table. I'm sure he and Mike Hester talked at length about how to implement the CRC value for CDC. As for collisions (as long as you use the CRC32 routine), it is highly unlikely that a two di...

Rod, Having worked with the CRC32 routine before for doing change data capture, I understand your dilemma. I have addressed the persistent hash file issue by unloading the hash files to flat files at the conclusion of any update process. This gives me a backup copy of the complete hash file contents...

Lance, Remember that sparse lookup option puts records into the lookup dataset as it finds them in the (DB2 or Oracle) database. Subsequent lookups will retrieve from the dataset instead of having to make the call to the database. This works well when you reference a small number of different keys i...