Search found 114 matches

by clshore
Wed Dec 20, 2006 1:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: TimeStamp Difference
Replies: 11
Views: 5590

ray.wurlod wrote:Was the second post a "jitter on your Windows box"? :lol:
Yes, in fact it was!
by clshore
Tue Dec 19, 2006 9:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: TimeStamp Difference
Replies: 11
Views: 5590

Getting jitter free microsecond resolution from Wintel platform will be difficult. There are hardware plugs-ins that can easily resolve to that granularity, but associating the timestamp to the event still requires the CPU and OS, which are too often busy doing other things. Here's a link to folks f...
by clshore
Tue Dec 19, 2006 9:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: TimeStamp Difference
Replies: 11
Views: 5590

Getting jitter free microsecond resolution from Wintel platform will be difficult. There are hardware plugs-ins that can easily resolve to that granularity, but associating the timestamp to the event still requires the CPU and OS, which are too often busy doing other things. Here's a link to folks f...
by clshore
Tue Nov 14, 2006 4:19 pm
Forum: General
Topic: How do you call a file that has SQL scripts
Replies: 8
Views: 7534

Is your DS server running on UNIX or Wintel? On UNIX I typed 'sqlplus -help', which gives you info for running from command line, such as this example: sqlplus -S <userid>/<passwd>@<connect_identifier> @<scriptname> The named script contains your multiple sql statements. Don't forget about handling ...
by clshore
Tue Nov 14, 2006 3:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The passion of writing PX Routine, not paying off
Replies: 2
Views: 2407

I noticed that you compiled with gcc, what UNIX platform are you on? ISTR that they tightened up on supported compilers, if you read the release notes there is more info. I was able to create a PX routine, just followed the instructions in the documentation. Can't remember if it was *.o or *.so thou...
by clshore
Thu Nov 09, 2006 12:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: FULL outer join
Replies: 20
Views: 8508

Maybe others have had better experience with the Merge stage than I. I implemented a full outer join with Merge (uggh, what a PITA for lots of columns). It worked perfectly, but was slow, and metadata changes were awful. I then used the two Xfm stage method, and got, roghly 5x better performance, an...
by clshore
Thu Nov 09, 2006 12:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORAOCI9 Stage
Replies: 4
Views: 2942

I have seen instances where the generated and custom SQL statements used different job parameters, and when running the job, you still had to supply values for both.

A minor annoyance.

Carter Shore
by clshore
Mon Oct 30, 2006 3:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Decimal to COMP3
Replies: 18
Views: 10579

I agree that you should push back.
But if you do have to create COMP-3, it's not really that bad (I've done it).

Let us know.

Carter
by clshore
Wed Oct 18, 2006 4:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Read Binary (BCD) file with variable length records
Replies: 4
Views: 4721

Are these Call Detail Records? Depending on the record format, there is often feature encoding at the bit level, as well as BCD encoding of digits. Not convinced that DataStage is the right tool for this job, but if you insist, then you wil probably have to disassemble each record piece by piece, ie...
by clshore
Thu Sep 28, 2006 7:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: replacing a string
Replies: 17
Views: 9535

True for the buildop, but don't Custom Functions become available to choose via the expression editor menus in Parallel Transformer?
ISTR adding one (it's been a year or so back).

Carter
by clshore
Tue Sep 26, 2006 4:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: replacing a string
Replies: 17
Views: 9535

Since it's EE, why not a function or buildop based on C regcmp and regex?
Build it generically enough for re-use, and voila, you have a new arrow in your quiver.

Carter
by clshore
Wed Aug 09, 2006 10:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get number of working days in a month in SQL
Replies: 12
Views: 6100

Tough to do in plain Sql without some kind of calendar table, but assuming you DO have column 'date' in 'dateTable', this will count the weekdays in a specified year and month: select count(*) from dateTable where to_char(date,'YYYYMM') = '200608' -- specify the year and month and to_char(date,'D') ...
by clshore
Mon Jul 31, 2006 1:56 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: Cannot Continue
Replies: 3
Views: 4881

Yikes,
Been a while since I set mine up, and have not touched it since.
ISTR that you install/modify the Message Switch using the Install CD.

Is it hosted on a Windows or UNIX box?

I can find the Docs somewhere if that helps any.

Carter
by clshore
Mon Jul 24, 2006 1:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to count records in unix
Replies: 8
Views: 5137

Or,
try nawk:

nawk -F'@@#' '{print NF}' yourFile.xml

The -F specifies a Regular Expression for field seperator, the NF is the number of fields.

I don't think '@' or '#' are ERE metacharacters, but if so, just backslash escape them.

Carter
by clshore
Mon Jul 17, 2006 3:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fixed width columns on the target file.
Replies: 7
Views: 3822

Append a comma to each field except the last.
Redefine the width of each column by one.
Write them as fixed width.

Carter