Search found 178 matches

by nvalia
Thu Apr 11, 2013 7:13 am
Forum: General
Topic: Seq Looping Completion based action
Replies: 5
Views: 2445

Thanks Chulett, that works.
by nvalia
Wed Apr 10, 2013 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge Statement SQL Server ODBC Connector
Replies: 8
Views: 13125

Merge Statement SQL Server ODBC Connector

Hi, DS 8.7 on Windows and DB is SQL Server 2008 (both Src and Tgt) We have Stage table and Final table. We Truncate and load the Stage table from a Flat file and then Update or Insert the Final table, based on the Primary Key matching between the 2 (SCD Type 1) Volume..the Stage Table gets daily abo...
by nvalia
Wed Apr 10, 2013 1:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Different Config Files for Sequence and Child Job
Replies: 4
Views: 2756

Different Config Files for Sequence and Child Job

Hi, JobA uses a 1 Node Config file by setting the ENV Var $APT_CONFIG_FILE to point to different config file (instead of the default.apt) in the job and it works fine. But now when we call this job in a Sequence we need to add this Env Var to the Sequence as well and set it to use 1Node file and fin...
by nvalia
Wed Apr 10, 2013 12:52 pm
Forum: General
Topic: Seq Looping Completion based action
Replies: 5
Views: 2445

I did not understand this..From the EndLoopActivity it allows only Unconditional trigger and right now I have it back to the Start Loop..If I add another one here it will send an email for every iteration where as I want only for the last one I achived this by having another link with a Custom trigg...
by nvalia
Wed Apr 10, 2013 11:00 am
Forum: General
Topic: Seq Looping Completion based action
Replies: 5
Views: 2445

Seq Looping Completion based action

Hi, DS 8.7 on Windows I am using a Start Loop and End Loop activity stage in a Seq job for a file pattern polling. On File Arrival I break of the loop and do the required action. This works fine. But in case the loop finishes all its Iterations (means file did not arrive in pre-defined path) I need ...
by nvalia
Tue Apr 09, 2013 10:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage Varying Results
Replies: 4
Views: 1619

BI-RMA you are correct.

The source data was varying since for testing there was a top n clause used to restrict the data..

So Datatstage does give predictable results when partitioned and sorted correctly, as expected.
by nvalia
Tue Apr 09, 2013 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage Varying Results
Replies: 4
Views: 1619

The input data has Definately not changed as I am the one controlling it..I can say this with certainity

I also know I should not get different results, but I am and hence checking if there is anything else I can do in the design/flow
by nvalia
Tue Apr 09, 2013 8:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage Varying Results
Replies: 4
Views: 1619

Join Stage Varying Results

Hi, DS 8.7 on Windows I am doing a left Outer join (Join Stage) on an Integer key field and both inputs are Hash Partitioned and Sorted (inbuilt Join stage sort used) on the same key (No Nulls on either links) But when the same job runs multiple times I am getting varying number of Duplicate records...
by nvalia
Tue Apr 02, 2013 10:21 am
Forum: General
Topic: Wait for File Wild Card Seq File
Replies: 6
Views: 5964

To add further.. I am using this Trigger Condition for Success in the Execute Commannd stage (Script will output 0 and exit with 0 for success) ECA_BatFile.$ReturnValue=0 AND Convert(@FM,"", ECA_BatFile.$CommandOutput)=0 For other loop link..simply use Otherwise as the trigger condition to...
by nvalia
Tue Apr 02, 2013 10:18 am
Forum: General
Topic: Wait for File Wild Card Seq File
Replies: 6
Views: 5964

Thanks Poovalingam.. I was able to get this to work based on your 3 step solution. So now the job starts at a predefined time..the Loop starts and looks for the file (wild card search) through the Script, if file exists then it exits and the downstream process starts if does not find any files, it s...
by nvalia
Wed Mar 27, 2013 10:37 am
Forum: General
Topic: Wait for File Wild Card Seq File
Replies: 6
Views: 5964

Poovalingam..

I do not know when the file comes in and hence need the Wait for File Stage to poll and trigger the process on arrival..

So when will I run the Execute Command stage as you mentioned below?
Can you please explain your solution in that context as I do not understand

Thanks
by nvalia
Wed Mar 27, 2013 9:48 am
Forum: General
Topic: Wait for File Wild Card Seq File
Replies: 6
Views: 5964

Wait for File Wild Card Seq File

Hi All, We have a requirement to poll for a Dated file in a specified directory. I was thinking of using a Wait For File Stage in the Sequence job to do this (we do not have a Scheduler) but I found in another post that Wait for File does not support Wild Card Search (File Pattern) I tested this and...
by nvalia
Tue Mar 26, 2013 2:25 pm
Forum: General
Topic: Exception Handler Not Working when DS invoked from Shell Scr
Replies: 1
Views: 1347

Resolved This was happening because the dsjob was called from the shell script using the option -warn 1 and hence as soon as the first warning prior to the failure was logged, the job aborted and hence the Exception Handler was not executed (hence no email) Changed this to -warn 2 in the dsjob comma...
by nvalia
Tue Mar 26, 2013 2:12 pm
Forum: General
Topic: Exception Handler Not Working when DS invoked from Shell Scr
Replies: 1
Views: 1347

Exception Handler Not Working when DS invoked from Shell Scr

Hi All, DS 8.7 on Windows I have a Sequence job that has an Exception Handler stage that sends an email in case of an exception. When I run (fail) this job from the Designer Client it works fine, meaning sends an Email in case of failure, as expected. But when I Invoke the same job with same paramet...