DSXchange

What is the best way to define a constraint in my situation where I am performing a lookup and want the key column of my source link to match the key column of the lookup link, but i only want data where my non-key column does not match. In psuedocode, this constraint looks like this.... (source.key...

Resolved by implementing loop stages - but this required duplicating logic.

I needed to obtain a value from the job before using this in the start loop stage. The the initial logic is duplicated between the loop stages.

Any constructive comments stilll ... around the duplication especially?

I have a sequencer that I would like to have loop. Heres the design: user variables - -> sequencer (any) - -> job1 (writes 1 record to a file) - - > Errors ↑ | | ↓ | Command (head to read file) | | | ↓ Command (sleep 5) < - - Condition (sleep/continue) - - > job2 I expect that when the sleep conditi...

uhhh, the lookup data is sourced from another system - i.e another database. Then the inline sub-query won't work.

buttons to clear all derivation within the respective stages.

there should be some way to limit the lookup data that is written to a hashed file. e.g. i extract 100 000 rows from a source (lets assume a subset of the customer base) and need to do a lookup on the latest order from a table in a different system with 10 000 000 rows (lets assume its the orders su...

sequencers should have a stage that reads a single row from a file, or from a database so taht parameters can be passed to jobs easily.

Thanks Craig, There are no space problems. We have ensured that each project's files are created on seperate disks - away from the Projects and engine. Space is definately no issue. Resarting DataStage has (even re-installing DataStage) treats the symptom for a few days, but then we're back to the s...

A few months ago, when we were running DataStage 7.1, we experienced some job corruption. We established, with the help of IBM support, that there was file corruption occurring in the engine. We addressed the symptoms by re-creating the affected projects or re-installing DataStage. About 2 months ag...

I'm creating some jobs to do job reports. Firstly, I have the names of the jobs that I want statistics for defined in a table. I put these into a file so that I can loop through the file and obtain the statistics. I've attached the code (which doesn't compile at this stage) which is still a WIP, but...

Add to that, what are the memory considerations from a hardware perspective.

Is there much memory needed to create and read from hashed files?

We are having problems with creating hashed files. We have to perform lookups against large data - either 3 million rows with 50 cols or 20 million rows with few cols. When creating this file, at some point the performance just slows and the file seems to stop growing. We've looked - the file is wel...

One of our projects has become corrpupted. I am trying to delete the project via Administrator but can not. I get the following error as soon as I select the project name in Administrator. Failed to connect to host: vspdwh, project: TariffOptimiser ( The directory you are connecting to either is not...

Thanks all for the input. I changed the "FTP Data Connection Mode" from passive to active and changed the "Link Tracing Level" from 0 to 4 and it works!

FTP server works yes. FTP via command line works too. I'm wanting to user the Stage - this cuts out having to create a unix file and scripting the transfer....