Search found 72 matches

by gagan8877
Wed May 06, 2009 11:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Importing Metadata from text file
Replies: 1
Views: 834

Importing Metadata from text file

I have a .txt file that contains column definitions (metadata) for approx 100 columns (the actual data file is separate). I want to import the metadata into DS. Whats the easiest way to import it? I had a look at the schema chapter in Parallel Job dev's guide but that seems a lot of work as the form...
by gagan8877
Sat Nov 29, 2008 4:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Sequential File is Parallel
Replies: 6
Views: 7591

ray.wurlod wrote:Ah, read FROM multiple nodes.

In that case the answer to your question 2 is "yes", provided that all the nodes can see the large file.
Thanks Ray - u rock :)
by gagan8877
Sat Nov 29, 2008 12:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort options
Replies: 5
Views: 1913

1. No, setting stable sort alone will not cause the data to be sorted. However, this option does not become available unless you choose to sort the data (and specify sort key(s)) - it is THIS that gets the data sorted (whether a stable sort or not). 2. See answer to 1. 3. You specify this property ...
by gagan8877
Sat Nov 29, 2008 12:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Sequential File is Parallel
Replies: 6
Views: 7591

1. Maybe. It depends where the files are and how many of them there are. 2. There is no "read multiple nodes" - there is "multiple readers per node". In this case, if you specify N readers per node for one sequential file, only one node gets used, and each reader on that node re...
by gagan8877
Thu Nov 27, 2008 7:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Sequential File is Parallel
Replies: 6
Views: 7591

Confusion Rising....

1. False. 2. False. 3. No. Thanks Ray - I am actually more confused now. The posts that I read earlier were opposite of this: http://www.dsxchange.com/viewtopic.php?t=104589 http://www.dsxchange.com/viewtopic.php?t=120434 Or may be I misunderstood. :? Do you mean that 1. If I specify multiple Seque...
by gagan8877
Thu Nov 27, 2008 7:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort options
Replies: 5
Views: 1913

Not correct. Stable sort means preserve the ARRIVAL ORDER OF ROWS - nothing to do with keys at all. My bad - I meant duplicate Key Values. 1. So lets say I have a dataset which is not sorted in the upstream stage and I set Stable Sort in the downstream stage - will be it sorted and the stage will t...
by gagan8877
Thu Nov 27, 2008 5:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Sequential File is Parallel
Replies: 6
Views: 7591

Reading Sequential File is Parallel

I am trying to read a big Flat file, that takes 20 min to open up by Notepad++. The question is related to "No. Of Nodes per Node" Vs. "Read from Multiple Nodes" properties. From posts I gathered: 1. Sequential Files can only be read sequential i.e. 1 file per node. 2. "Read...
by gagan8877
Thu Nov 27, 2008 2:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort options
Replies: 5
Views: 1913

Therefore,

They are not the same. Stable sort can apply even when you are not using either of the "Don't sort" options. Stable sort preserves existing order of rows when the sort keys match. This needs more memory than not doing a stable sort. Thanks Ray. So as I understand, Don't Sort means - leave...
by gagan8877
Tue May 27, 2008 6:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Err: the PWD environment variable is not defined
Replies: 2
Views: 1375

Err: the PWD environment variable is not defined

Hi gurus I have Win XP SP2 + MS Do Net Framework 2.0 SP1 + MS Do Net Framework 3.0 SP1 + MS Do Net Framework 3.5 + VC++ 9.0 Express + Turbo C++ 4.5 and DS Enterprise 7.5x2 I installed VC++ 9.0 after DS, then removed DS, installed TC++ 4.5 as well and then reinstalled DS. Also added the PWD variable ...
by gagan8877
Sat Mar 08, 2008 1:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Replacing Single Quote with 2 Single Quotes
Replies: 2
Views: 2063

Replacing Single Quote with 2 Single Quotes

I have scenario, in whic data is being load to SQL Server db using DTS from flat files generated by DS. There is a varchar field that contains quotes and DTS bombs out saying too many columns. Here is the pseudocode: If there is a single quote or double quote present then if in between characters ar...
by gagan8877
Tue Feb 05, 2008 2:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuration Error
Replies: 1
Views: 1231

Configuration Error

Any idea why is this happening? -------------------- main_program: conductor node DS002 unknown via gethostbyname; h_errno = 0 main_program: Accept timed out retries = 8 main_program: The section leader on DS002 died main_program: **** Parallel startup failed **** This is usually due to a configurat...
by gagan8877
Wed Oct 31, 2007 9:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MultiLoad returned: 20 Error
Replies: 3
Views: 2670

UV - Universe, ultra violet or unique violation

im a bit rusty on this but believe the problem is that you are getting a Unique Constrain violation if you look at the last lin es 0025 .if &SYSUVCNT then; **** 00:38:04 UTY2402 Previous statement modified to: 0026 .if 1 then; 0027 .logoff 20; This I beleive means that it has found >0 records i...
by gagan8877
Mon Oct 29, 2007 9:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MultiLoad returned: 20 Error
Replies: 3
Views: 2670

Re: MultiLoad returned: 20 Error

Any point towards where to look will be also be appreciated. Pls give your suggestions.
by gagan8877
Mon Oct 29, 2007 8:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MultiLoad returned: 20 Error
Replies: 3
Views: 2670

MultiLoad returned: 20 Error

Hi Gurus I have inheritied a few jobs that load data into the TeraData database using Multiload. One of the jobs has: .logtable #$TDWorkDB1#.NEX_LOG_INS_#TableNm1#; .logon #$TDPID#/#$TDUserId1#,PASSWORD; .set DBNAME to '#$TDDB1#'; .set TBNAME to '#TableNm1#'; .set JOBNAME to '#ThisJobNm#'; .begin im...
by gagan8877
Thu Oct 11, 2007 3:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Convert accented characters to english
Replies: 9
Views: 10100

Post your syntax - the suggestion was strictly in regards to using one rather than a bajillion inline function calls. The syntax still contains a billion functions: Convert(Char(135),'c', <snip> :? Not if you set it up correctly. The online help shows it takes a list of characters to look for and a...