Search found 114 matches

by clshore
Thu Mar 31, 2005 5:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Is there any DB2 SQL Builtin Conversion from EBCDIC - ASCII
Replies: 3
Views: 2383

I used to do a 'tricky' conversion with Informix, reading an EBCDIC flat file into the DB as an external table, then writing it back out to a different ASCII flat file. The key to success of course was the metadata, to correctly describe the two external files. Given DB2's roots and parents, I'd be ...
by clshore
Wed Mar 23, 2005 3:33 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can DSv7 read CDR raw data?
Replies: 5
Views: 3588

If your CDR's are in ASN.1 format, then the best solution is to use an ASN.1 decoder, implemented in some other language (C++, Perl, Java, etc.). AFAIK, DataStage does not natively support ASN.1. Trying to do one yourself in DataStage will likely not result in the kind of performance that CDR proces...
by clshore
Tue Mar 15, 2005 10:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: process for previous month data range
Replies: 10
Views: 5979

No, I don't think so: select months_between(to_date('2005-02-01','YYYY-MM-DD'),sysdate) lo, months_between(to_date('2005-02-28','YYYY-MM-DD'),sysdate) hi from dual gives: lo hi ------- ------- -1.466 -.595 We want to process all records in range 2005-02-01 to 2005-02-28, but above would exclude the ...
by clshore
Tue Mar 15, 2005 9:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: process for previous month data range
Replies: 10
Views: 5979

That's the whole point, it compares the month/year of the candidate record to month/year of previous month, and processes if the same (isn't that what you want?) So if you run it right now: select to_char(add_months(sysdate,-1), 'MMYYYY') from dual You get the month/year of the previous month (year ...
by clshore
Mon Mar 14, 2005 2:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: process for previous month data range
Replies: 10
Views: 5979

You can use the Oracle add_months() function to get previous month/year: prev_month_year = to_char(add_months(sysdate,-1),'MMYYYY') So your condition would look something like this: WHERE to_char(FIELD_HISTORY.MODIFY_DATE, 'MMYYYY') = to_char(add_months(sysdate,-1), 'MMYYYY') Remember to add checks ...
by clshore
Thu Mar 03, 2005 11:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Uniqueness of data in a table
Replies: 14
Views: 5421

Why not let the target DB engine do the heavy lifting?
First load all the rows into table A.
Then select unique from A into B, generating your B sequence number as you go according to the capability of your DB (Oracle sequence, etc.)

Carter
by clshore
Tue Mar 01, 2005 7:52 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Join tables from 2 different databases
Replies: 14
Views: 5878

Another option if the data set is not huge, is to use the Merge stage. This stage reads flat files, and will perform various Left, Right, and Inner joins to create output datasets. Query each DB, creating a flat file, then use the merge stage to join them. Some people find ithe Merge difficult to se...
by clshore
Mon Feb 28, 2005 6:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: varchar to date conversion on DS 7.5
Replies: 6
Views: 5407

Use an Oracle Date formatter like 'MONTH DD YYYY HH:MI AM' with your to_date().

Carter
by clshore
Mon Feb 28, 2005 3:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to read this file?
Replies: 6
Views: 2358

So, is this a translated COBOL file or what? Is the FD available?
Perhaps you can deal with it as Complex Flat File.

Carter
by clshore
Thu Feb 24, 2005 1:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ds job run errors
Replies: 6
Views: 2087

Since you didn't post *exactly* what you are submitting on the command line, it's harder to answer your question. Remember that the shell gets first crack at anything you submit on the command line. So be sure thet there are no alias definitions or whatnot that match in your invocation. Make sure th...
by clshore
Thu Jan 20, 2005 11:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Limiting Job Parallelism
Replies: 16
Views: 7808

If you are talking about commercial job schedulers, then most have some notion of resource allocation. You can, for example, define a resource, and it's max load (100 for example), and then associate a resource load value for each job (10 for example). The scheduler will wait until sufficient resour...
by clshore
Tue Jan 18, 2005 9:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: initializing parameter, inside a transformer stage
Replies: 5
Views: 1320

Oops, forgot to say that you should document such kludges *very* thoroughly.

Carter
by clshore
Tue Jan 18, 2005 9:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: initializing parameter, inside a transformer stage
Replies: 5
Views: 1320

You didn't specify what database. One way I have used with Oracle OCI stage, is to dynamically create the Sql statement into a named flat file, then specify that file as the source of the query in the OCI stage. ex) Derive the date value into stage variable dateSvar. Write the query into flat file D...
by clshore
Wed Jan 05, 2005 3:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: First occurence out of a group of records.
Replies: 11
Views: 4460

Do as Ken suggested, writing the query output into a hash, but reverse the ORDER by clause so the the LAST record written into the hash is the FIRST one that you want. When the query completes, what remains in the hash will be all of the FIRST records.

Carter
by clshore
Tue Aug 03, 2004 8:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Export -- xml vs .dsx format
Replies: 15
Views: 28242

At my client site, they uses ClearCase. It doesn't play nicely with a *.dsx file, but is OK with *.xml, hence that's what we export for checkin/checkout.

I also prefer *.dsx for my own uses.

Carter