Search found 46 matches

by jatayl
Thu Mar 20, 2008 1:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Need to get the non-matches
Replies: 3
Views: 1522

You have two non-matches: (1) Those, which are in the seq-File and not in Oracle (2) Those, which are in Oracle and not in seq One way is to read the the key of the seq-file completly into oracle and make there two minus. (1) minus (2) and (2) minus (1) I need the rows that are in the Oracle table ...
by jatayl
Thu Mar 20, 2008 1:28 pm
Forum: General
Topic: Using XML files as source
Replies: 6
Views: 1595

I was approached to write a couple of pilot jobs for different input sources to load a table, one sequential and the other xml. I found that if there are many sources, it was more beneficial to use the flat file versus an xml file, becuase I could identify the table/schema file, and write one job to...
by jatayl
Mon Mar 17, 2008 3:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem loading from XML to Sequential File
Replies: 15
Views: 3463

I'm not Ernie, but I would use <OrderLine> as your repetitive key.

:)
by jatayl
Mon Mar 17, 2008 1:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem loading from XML to Sequential File
Replies: 15
Views: 3463

Re: Problem loading from XML to Sequential File

Below is the XML file: My key column is ReceiptLine ItemID="10000801" I have enabled Repetion key in enabled...... Please let me what i m missing in the construction. <Receipt DocumentType="0005" ReceivingNode="Innotrac_H" ReceiptDate="" ReceiptNo="20080...
by jatayl
Mon Mar 17, 2008 11:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem loading from XML to Sequential File
Replies: 15
Views: 3463

Why are you bringing all your data in through the folder stage? Why not just the filepath, and then chose url/File Path radio button with the filepath as your input field in the xml stage?

Did you try making ReceiptLine your repetitive key?

[/quote]
by jatayl
Thu Nov 08, 2007 1:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

Yes, I meant increase. This is what was suggested: "The default hardcoded segment value of 0x40000000 for DMEMOFF should be moved to 0x90000000 The default hardcoded segment value of 0x50000000 for PMEMOFF should be moved to 0xA0000000 Along with the following line should be added to the dsenv ...
by jatayl
Wed Nov 07, 2007 1:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

This issue has been resolved. IBM engineers took on the problem and asked us to reset values within the uvconfig for DMEMOFF and PMEMOFF, and adding LDR_CNTRL variable in the dsenv file.

Just an fyi.

Thanks,
Jason
by jatayl
Thu Oct 18, 2007 12:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: what is the difference and activities of Sequence &Seque
Replies: 8
Views: 2467

Couple this question with these old chestnuts; 1. What is the acronym APT? 2. What's the difference between a transformer and routine? and I figure somebody is ramping up for a DS Project in Chennai or Mumbai. 1. A Pre Test..... 2. the same difference as a sequential file stage and a configuration ...
by jatayl
Mon Oct 08, 2007 12:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

Yes, I was mistaken. I was thinking about another job that utilized the data within the xml to conduct lookups. Yes, I could just read the file names, parse the data from the filenames that I need, and then output to a resulting file. Use that file as a driver file to move the original source data t...
by jatayl
Mon Oct 08, 2007 12:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

I'm not actually reading the data within the xml file. I'm using part of the file name as values for a lookup. I'm just passing the contents of the source file to the destination directory. Why would I need to use the xml stage if I'm not actually parsing the xml file.

Thanks,
TAZ
by jatayl
Mon Oct 08, 2007 11:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

They have to be separate. They are xml files.

Thanks.
by jatayl
Mon Oct 08, 2007 10:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

Actually, with my original design, I'm using the data in each file to lookup to a table and a hash file. Then using constraints to output to different directories.

Thanks,
TAZ
by jatayl
Mon Oct 08, 2007 8:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Folder Stage -Large file- 50 mb can't process
Replies: 11
Views: 7175

Folder Stage -Large file- 50 mb can't process

Okay, just in case anyone else has run across this issue, I'm posting my problem on this forum. Job information: folder stage to transform to folder stage. I'm reading all files in one directory and writing them to another directory. Initially, the job contained lookups, and seq err outputs, but I'v...
by jatayl
Tue Apr 17, 2007 4:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Introduction
Replies: 7
Views: 3312

Just start writing jobs with data, and use a little "trial and error, mostly error"
by jatayl
Mon Apr 09, 2007 3:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: GETTING BETTER PERFORMANCE FOR ORACLE LOAD
Replies: 5
Views: 1740

What version of Oracle are you on? 9.2.05, I believe, has a bug that causes DataStage loads to take forever....I believe it had something to do with querying DBA Extents, or something like that....