Search found 210 matches

by sbass1
Mon Mar 09, 2009 9:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Logically concatenate sequential files
Replies: 5
Views: 2730

Logically concatenate sequential files

Hi, I searched on "concatenate", found this link: http://www.dsxchange.com/viewtopic.php?t=125140&highlight=concatenate This hit specifically said to physically concatenate the files external to DS before processing. However, is it possible to logically concatenate sequential files wit...
by sbass1
Mon Mar 09, 2009 8:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

SETFILE is in the UniVerse doc set. Hmmm, the questions just keep coming :wink: 1. Here is the list of locally installed doc on my machine: C:\Program Files\Ascential\DataStage7.5.1\Docs>dir Directory of C:\Program Files\Ascential\DataStage7.5.1\Docs 23-Dec-04 10:28 1,669,527 advpx.pdf 23-Jun-04 12...
by sbass1
Mon Mar 09, 2009 5:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

So I did a PDF search as follows: Acrobat Reader Search all PDF documents in C:\Program Files\Ascential\DataStage7.5.1\Docs (53 documents in total) "SETFILE" Not one single hit. DS Designer and Administrator help files. Not one single hit. Yes a search of DSXchange on SETFILE returns 194 h...
by sbass1
Fri Mar 06, 2009 12:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

Now, you can create a hashed file wherever you like and then create a VOC pointer in the project to that location and reference it by that pointer name in the UV stage. Sorry I don't know how to do that. I searched the doc set on "VOC" and got a lot of hits. It looks like the Basic Guide ...
by sbass1
Thu Mar 05, 2009 11:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

Thanks Ray and Craig. I hit the doc, saw "localuv", success. Question: can I specify where the hashed file gets written? We like to keep all our hashed files in one spot for file system cleanup, etc. I tried #$HashFileLocation#/#DSJobname#_#DSStageName# for the table name, but no joy: Scot...
by sbass1
Thu Mar 05, 2009 10:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

I think I've made progress on this topic... I've created a simplified job to test my approach. When I had DS create the container, it looked something like: Source DRS --> xfm --> Target DRS ==> Output where ==> is a reference link (dotted line) This setup allowed the job to compile. Now my question...
by sbass1
Thu Mar 05, 2009 6:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

"Outer" job: DRS source --> xfm with hashed files for reference links --> DRS target One of the reference links is the container Container: DRS source --> xfm with hashed files for reference links --> Output stage (container box, blue arrow going out) I assume when I drag a container stage...
by sbass1
Thu Mar 05, 2009 5:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a local container be used as a reference input?
Replies: 16
Views: 8545

Can a local container be used as a reference input?

Glossary: NK = Natural Key SK = Surrogate Key Job design: Source Table containing NKs --> xfm with a bunch of reference links --> Target Table containing mix of NKs and SKs One of the reference inputs is a hashed file containing nothing but SKs. So, I have to do another "bunch of reference inpu...
by sbass1
Wed Mar 04, 2009 9:16 pm
Forum: General
Topic: Can I use a SQL Server #Temp table in another transformation
Replies: 3
Views: 1763

Can I do select distinct <composite key> on the Universe table?
by sbass1
Wed Mar 04, 2009 6:49 pm
Forum: General
Topic: Can I use a SQL Server #Temp table in another transformation
Replies: 3
Views: 1763

Can I use a SQL Server #Temp table in another transformation

Job Design: Seq File --> xfm1 --> SQL Server #Temp table --> select distinct --> xmf2 --> SQL Server final table I need to do a bunch of lookups in xfm1, where the lookups will map source data to different values (example effective date to month surrogate key). I then need to write the distinct rows...
by sbass1
Wed Mar 04, 2009 6:36 pm
Forum: General
Topic: Using for loop in sequential stage filter command
Replies: 1
Views: 1093

Using for loop in sequential stage filter command

I'm experimenting with the sequential stage filter command... I've discovered I can do something like: File name: /dev/null (It seems DS requires a file name for the filter command, although I don't see why it should. What if my filter command doesn't require a file?) Filter command: head -5 /tmp/de...
by sbass1
Tue Mar 03, 2009 6:56 pm
Forum: General
Topic: Changing case of parameters on the fly
Replies: 8
Views: 5407

You could split the job logically as follows: 1) GetParameters (read your metadata to get your parameters) 2) UseParameters (your current "downstream" job) Then call both jobs within a sequencer job. 1) would read your table, set UserStatus based on your table data, the job sequencer would...
by sbass1
Tue Mar 03, 2009 6:54 pm
Forum: General
Topic: Changing case of parameters on the fly
Replies: 8
Views: 5407

You could split the job logically as follows: 1) GetParameters (read your metadata to get your parameters) 2) UseParameters (your current "downstream" job) Then call both jobs within a sequencer job. 1) would read your table, set UserStatus based on your table data, the job sequencer would...
by sbass1
Tue Mar 03, 2009 6:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Insert date value into SQL Server datetime columm
Replies: 31
Views: 28636

(Scroll to the end for a summary...) Hi Craig, OK, I've got a DS server job as follows: SeqFile --> Extract (link) --> xfm --> Load (link) --> DRS Stage (MS SQL Server) The SeqFile contains two rows: 2009-09-30 2009-09-30 12:34:56 The column is defined varchar (doesn't really matter for a seq file a...
by sbass1
Tue Mar 03, 2009 4:05 pm
Forum: General
Topic: Loading XML data from a URL into a SQL Server table
Replies: 6
Views: 3215

Hi Ernie, Thanks for all your replies. Much and genuinely appreciated. I'm neither an XML nor RSS guru (I've played with it some), and this appears to be falling into the too hard basket. So, things I've tried: * opened a local copy of the RSS XML file in Eclipse (I suspect any XML-aware editor woul...