DSXchange

Are there performance differences between: 1) DRS (Sybase database) and Sybase OC stage? 2) DRS (SQL Server database) and SQL Server stage? Is the DRS stage just a wrapper around the native stages, i.e. if I chose the Sybase database in the DRS stage, does it use the same drivers as the Sybase stage...

I have a follow up question regarding the approach in http://etl-tools.info/en/datastage-tutorial-L008_scd-implementation-datastage.htm. The T001_Lookups transformer stage http://etl-tools.info/images/scd2-transformer-lookup.jpg has the constraint: not(Lkp_Cust.NOTFOUND) IOW do that processing only ...

chulett wrote:Sure, just use two separate hashed file stages with the transformer, not a single one with two different link types.

Thanks Craig. Just to confirm, the two separate hashed file stages can reference the same physical hashed file?

Since a picture is worth 1000 words, here are pics of my job design: http://docs.google.com/View?docid=dcdxxjr8_5hcfwbkdn&pageview=1&hgd=1&hl=en http://docs.google.com/View?docid=dcdxxjr8_7gd3jzbcb&pageview=1&hgd=1&hl=en I know the problem: I'm trying to write to the same has...

venkates.dw wrote:Hi,
Please give me reply...

Then please give us more details. What is your source data? Is it already stored in internal date format, or is your data a text string coming from a sequential file? You may want to research the SQL convert function, and the DataStage iconv and oconv functions.

There are a lot of factors involved, but I've noticed that a lot of writes to the job log can really slow it down.

Doh! Of course. The "container" is the sequence job itself.

Thanks!

Our latest approach is: DRS (1) --> xfm --> DRS (2) --> hashed_file (2) ^ | DRS (2) -->hashed_file (1) This: 1) Ensures hashed_file (1) always exists 2) Is always in sync with DRS (2) (the target table) 3) Ensures new SKs are derived correctly Pros: Ensures the hashed file is always in sync with the...

So I have to code all dependencies "manually". Bummer. Was really hoping there was some way to: * Run A-E concurrently * Once A-E have finished successfully, run F->G->H->I sequentially * Once I has finished successfully, run J-L concurrently Thus the concept of "containers" to h...

Yes. F creates SK's based on some NK. G then saves the F's SK as an FK based on the NK.

So F needs to successfully complete before G starts.

Likewise for the other dependent jobs.

Hi, I've reviewed http://www.dsxchange.com/viewtopic.php?t=92114&highlight=CREATE+TABLE but still have this question... I have a job like: DRS --> xfm --> DRS --> hashed_file (2) ^ | hashed_file (1) where hashed_file (1) and hashed_file (2) are the same physical file. (sorry for the badly format...

Hi, Our job dependencies are something like: Group1: JobA JobB JobC JobD JobE These jobs are all independent of each other, and I would prefer they run multi-threaded. But, they should all successfully complete before... Group2: JobF --> JobG --> JobH --> JobI These jobs are all dependent on the suc...

Hi, I've searched the site on "SCD", "MD5", and "message digest". A summary of my research: 1) MD5 and CRC64 are not supported OOTB in DS 2) Others have gotten MD5 support as an external module: http://www.dsxchange.com/viewtopic.php?t=112259&highlight=MD5, but this...

There's no such thing as "the first row in a table". Yeah, good point. As noted, there are solutions available in parallel jobs, and your site does have Enterprise Edition. Perhaps you could investigate. If "my site" has Enterprise Edition, it's not in my department, nor accessi...

Thanks Ray, much appreciated... My "actual" requirement is creating a dimension table with: CountryCodeSK CountryCodeNK CountryDesc CountryCodeNK and CountryDesc come from a tilde delimited seq file. If any source file CountryCodeNK does not map to a valid CountryCode, I will map it to the...