DSXchange

Hi James Thanks for the valuable info. "1) Your lookup outputs nearly 200 times the number of source records and more than 200 times the data volume. Is this expected and is it correct?" Yes, this is correct. "2) The job is sorting the data prior to writing the output dataset (shown i...

Config File has 4 nodes. ----------------------------- ##I IIS-DSEE-TOIX-00059 21:46:28(000) <APT_RealFileExportOperator in APT_FileExportOperator,0> Export complete; 6 records exported successfully, 0 rejected. ##I IIS-DSEE-TFSC-00010 21:46:28(000) <main_program> Step execution finished with status...

Thanks a lot Vincent! That was thorough and detailed.

Thanks Ray, my requirement is that the user needs to access the report inside Cognos where all other reports are (from single location). Can workbench reports go into Cognos layer? Or will have to use DSJobReport to shred xml and then load into the dimensional schema for Cognos to access?

Hi Gurus In version 7x I relied mostly on DSJobReport and XML to extract job run stats and load them into the audit dimension and Error Event Schema. 1. Is there a better or easier way in v 8.5? Non-XML way? 2. I know we can generate reports in Metadata workbench manually by going into the console a...

Good analogy and thanks for the replies - I edited the original post to give you guys more info.

StringToDecimal(string_field)

basically the derivation is inside a Stage variable of datatype decimal(10, 0) and string_field is varchar(10).

I am trying to convert string field to Decimal in Transformer using: StringToDecimal(string_field) inside a Stage variable of datatype decimal(10, 0) and string_field is varchar(10). but I get: Transformer_7,1: Fatal Error: APT_Decimal::assignFromUInt64: the integer source (100013001) is out of rang...

Thanks Ray, I will make that correction in my job. But the question is can I have blank specifications in there that can be used later dynamically at runtime - as the article suggests. IBM documentation says there is no default for the Specification: http://publib.boulder.ibm.com/infocenter/iisinfsv...

The article "how-to-become-a-modify-stage-zen-master": http://it.toolbox.com/blogs/infosphere/datastage-tutorial-how-to-become-a-modify-stage-zen-master-20368 says "The Modify Stage is overloaded with specifications - it has 20 specification job parameters that are all set to blank an...

Hi All Thanks for all you replies. I tried with single node config file but the problem didn't resolve. I noticed that the problem only occurs if the job is run in the sequence, if I run it individually it produces the same results each time. This led me to focus on the job running upstream. Which h...

I wrote a job in which dataset is read is matched to a reference output which is coming from Oracle table. The match occurs via 10 parallel lookups on 10 different columns. The reference table always produced exactly the same no. of rows. The dataset also produces exactly the same no. of input rows....

When using DS 8.5 ABAP stage to extract data from SAP R/3 system: 1. There is a setting called qRFC queue name on the transfer Method tab (method = RFC). If you have 4 ABAP stages in 4 jobs to extract data, will you need to use different RFC queues in each stage to extract 3 diff tables? Whats the b...

Any ideas, feedback will be much appreciated.

Hi Gurus Sequence1 calls Seq2, which in turn starts a SeqMain via a routine (DSRunJob) activity inside a loop activity. SeqMain in turn starts the actual job invocation. Multiple invocations start in parallel all with different parameters. Then Seq3 starts a routine (DSWaitForJob) in a loop for each...

Is anyone monitoring system resources, particularly CPU, memory and disk space usage? If so, these logs may prove a fruitful source of diagnostic information. I would guess you have a contention for resources issue. Thanks Ray - We haven't monitored the system resources yet, but we are planning to ...