Search found 57 matches

by rupeshg
Fri Nov 14, 2008 8:09 am
Forum: General
Topic: Creating Files on the fly
Replies: 8
Views: 3165

I totally agree with you Mike. I have been working on DS MVS for last 3 years and I would not recommend anyone to change the generated code (unless you want to pass a parameter from run JCL). This was one exceptional case which required this sort of altering. (I would not mind as far as it does what...
by rupeshg
Fri Nov 14, 2008 6:58 am
Forum: General
Topic: Creating Files on the fly
Replies: 8
Views: 3165

Mike I think I did not explain it correctly. Following is the problem and its solution. Problem: .................... Customer table ..............................| ..............................| ..............................V Raw data -----> lookup -----> Files (Multiple) Source is raw data with ...
by rupeshg
Thu Nov 13, 2008 10:09 am
Forum: General
Topic: Creating Files on the fly
Replies: 8
Views: 3165

Mike Well, there are limitations of the tool as there are less options on transformation. This is what I am doing to resolve the issue. Hopefully it should work. At the end of the day, the datastage job is a cobol program. For it to run requires jcl and compile is compile jcl. I am developing a data...
by rupeshg
Thu Nov 13, 2008 9:37 am
Forum: General
Topic: Creating Files on the fly
Replies: 8
Views: 3165

Thanks Mike.

Its the option 1.

The need is to create different files for different customers, so yes, if 5 customers match, 5 files should be created.

Regards
Rupesh
by rupeshg
Thu Nov 13, 2008 8:03 am
Forum: General
Topic: Creating Files on the fly
Replies: 8
Views: 3165

Creating Files on the fly

Hi How can I create target files on the fly in datastage MVS job? Example: Source - Raw data (key Customer ID) lookup - Customer table (key Customer ID) target - dynamic (dynamically create fixed width files depending on the number of customers matched in lookup) Your help in this case will apprecia...
by rupeshg
Mon Oct 06, 2008 5:50 am
Forum: General
Topic: Rows per commit
Replies: 4
Views: 1755

Rows per commit

Hi Commit frequency in Job properties is related to the number of rows it processes. Meaning, if the values is 100, it will commit after 100th record is loaded successfully on the target table. This should be true for one output link to one target. What happens if the input is one and output links a...
by rupeshg
Mon Oct 06, 2008 5:40 am
Forum: General
Topic: Commit after job aborts
Replies: 1
Views: 1317

Commit after job aborts

Hi This query is related to DataStage mainframe job. The job reads from a DB2 table and performs inserts in different tables in one job. The commit frequency in Job Properties is set to 0, meaning that it should commit after all the rows are processed else rollback. But recently I've observed that i...
by rupeshg
Thu Dec 14, 2006 3:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look up and Relation stage in MVS
Replies: 6
Views: 3406

Yes it worked.
I was using Trim() function in my look up stage.
I removed it and no more CURSOR in the cobol code. :D

Thanks a lot for your help.
Rupesh[/img]
by rupeshg
Wed Dec 13, 2006 3:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look up and Relation stage in MVS
Replies: 6
Views: 3406

Yes The radio button is singleton for both the stages.

But i am really surprised why the datastage generates the code differently for two similar kind of look ups.
by rupeshg
Tue Dec 12, 2006 11:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look up and Relation stage in MVS
Replies: 6
Views: 3406

Look up and Relation stage in MVS

Hi All I am using two lookup stages and their respective Relational stages from which they do the look up. But in the cobol code generated , one of the sql is generated using cursor. and for the other look up stage its just a direct row fetch. I am not able to find out how can i stop the cursor gene...
by rupeshg
Thu Aug 24, 2006 5:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline/embeded SQL
Replies: 17
Views: 4852

Mike, one more problem which I am facing is Is there a way in MVS where I can handle a rejected row of Database Insertion due to Primary key constraint. As of now everytime I insert a row into a DB table I am doing a look up before that stage, to make sure if the row is existing in the table already...
by rupeshg
Tue Aug 22, 2006 4:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline/embeded SQL
Replies: 17
Views: 4852

Thanks Mike. Actually I didnt understand the part in the following quote. The best that you can hope for is that the code optimizer will push a transformer constraint back into the SQL WHERE clause. Do you mean to say that one of the constraint in WHERE clause can be put into transformer Constraint?...
by rupeshg
Tue Aug 22, 2006 10:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline/embeded SQL
Replies: 17
Views: 4852

Thanks a million Mike. That really helped. So far I was following the same approach, but did not think of spliting it first into a file and than looking up. DB2 table with query | | V input----->Transformer---->lookup----->Transformer------>DB2 Loadready File. Definately there would be a performance...
by rupeshg
Tue Aug 22, 2006 2:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline/embeded SQL
Replies: 17
Views: 4852

Mike, As I mentioned early, "billion of rows coming from Input and 1000s of rows in lookup table" this should expalin it all. But for your clarification Is it the relational table, FORM_TAB_V, the input source with the billion rows? Or is that the input source with thousands of rows? Answe...
by rupeshg
Mon Aug 21, 2006 4:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline/embeded SQL
Replies: 17
Views: 4852

Yes, we are talking about billion of rows coming from Input and 1000s of rows in lookup table.

Other two host variables are set to defaults like PB90H-FRM-ST-CD = 'UK' and PB90H-FORM-EDITION-DT = CURRENT_DATE

Hope that really helps.

Regards,
Rupesh