Search found 111 matches

by eph
Mon Sep 05, 2011 3:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate Schema with RCP and Timestamp
Replies: 9
Views: 6818

As it is actually impossible to use a ' ' (space) as null value for a datetime (which is longer), I've decided to put the type conversion later in the process chain, in a SQL query (that populate a table with datetime coming from a table where the data is a varchar). It's a pity though, since I was ...
by eph
Tue Aug 09, 2011 6:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate Schema with RCP and Timestamp
Replies: 9
Views: 6818

Hi Craig,

I've already tried a null value of 10 characters long, but as other types (varchar) could be null, in that case the null value should be

Code: Select all

' '
and not

Code: Select all

'          '
Maybe I'm missing some trick to do it, but nothing seems obvious to me in that case.

Eric
by eph
Mon Aug 08, 2011 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate Schema with RCP and Timestamp
Replies: 9
Views: 6818

Is there any way to handle null values for timestamp? I'm using a column import in which null value is given as a ' ' (space). In the importing field are mixed varchar/decimal/timestamp columns that could be nullable. I'm getting this warning : When validating import schema: At field "DATE"...
by eph
Tue Aug 02, 2011 9:48 am
Forum: General
Topic: Performances Tuning Tips
Replies: 12
Views: 7497

Hi all, I finally was able to run some preliminary tests lately. Here is the before/after : Before ==== uvconfig file's parameters were: MFILES = 2000 T30FILE = 65536 GLTABSZ = 50 RLTABSZ = 50 MAXRLOCK = 40 We couldn't handle more than 50 jobs running in parallel. After ==== uvconfig file's paramete...
by eph
Tue Aug 02, 2011 9:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate Schema with RCP and Timestamp
Replies: 9
Views: 6818

Hi Craig, This value is indeed too long for a timestamp, that's why it's truncated by the oracle stage when I use the 'classical' workflow (column import with varchar+transformer for type conversion=>oracle load). This problem is also present for the first line, where the value is ' ', which I assum...
by eph
Tue Aug 02, 2011 8:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchestrate Schema with RCP and Timestamp
Replies: 9
Views: 6818

Orchestrate Schema with RCP and Timestamp

Hi all, I'm facing some troubles trying to create a full generic job. The general idea is that I have to load on different oracle tables data coming from different files (and thus, having different schema). There I'm struggling with some issue using an orchestrate schema with a column import record ...
by eph
Thu Jun 30, 2011 3:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inserting/Updating Oracle Clob using RCP
Replies: 1
Views: 1975

Hi Colin,

Which Oracle Stage are you using? Oracle Enterprise or Oracle Connector? The second one is way handier for CLOBs.

Eric
by eph
Wed Jun 22, 2011 2:12 am
Forum: General
Topic: House Keeping
Replies: 4
Views: 2217

Hi,

May I ask for later version? Like 8.1? I'm used to use a script in the After job sub-routine, which calls orchadmin to remove Datasets from the workdir, but if there's an automatic way to do it, I'm interested.

Eric
by eph
Tue Jun 21, 2011 7:41 am
Forum: General
Topic: Performances Tuning Tips
Replies: 12
Views: 7497

Hi, I couldn't modify & test the new parameters' values due to client's requests on the target environment. Anyway, as I've seen in IBM RedBook on DS' best practices, It is not a good idea to create a huge pool of files to process, as they suggest to process as much as possible in one shot... I'...
by eph
Wed Jun 15, 2011 2:42 am
Forum: General
Topic: Performances Tuning Tips
Replies: 12
Views: 7497

Hi, Unfortunately, we are in an awkward situation since our "grid" installation is a passive - active one (one server's up, in case of failure the second one take in hand the activity). So we can't use a second server to balance the load. Anyway, bigger tests (on target type server this ti...
by eph
Thu Jun 09, 2011 9:07 am
Forum: General
Topic: Performances Tuning Tips
Replies: 12
Views: 7497

Re: Performances Tuning Tips

Jobs are quite complex in terms of functional requirements, thus it leads to complex jobs with a lot of aggregations, sorts, lookups... That is an interesting problem; please post what you end up doing. I ended up by developing my jobs :lol: Business requirements & the data integration platform...
by eph
Tue Jun 07, 2011 4:17 am
Forum: General
Topic: Performances Tuning Tips
Replies: 12
Views: 7497

Performances Tuning Tips

Hi all, I just wonder if you have some DS tuning tips for a "special case". My requirements are to be able to launch a lot of jobs in parallel (namely between 100 and 400), with little input for each. Each job will process 100 up to 1000 lines, either in sequential files, xml or database t...
by eph
Thu Apr 07, 2011 2:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to do a COMPUTE STATISTICS with Oracle Connector Stage
Replies: 3
Views: 2497

Hi folks,

Does anyone got an idea/tip?

Thanks
eph
by eph
Tue Apr 05, 2011 6:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to do a COMPUTE STATISTICS with Oracle Connector Stage
Replies: 3
Views: 2497

Hi all, Is there no one using this stage to do bulk load? Let me know if you have a better idea, my requirements are: - parallel bulk load after truncate - with constraints, indexes and triggers off - rebuild (switch on) of previous constraints, indexes and triggers in parallel mode - compute statis...
by eph
Mon Apr 04, 2011 4:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to do a COMPUTE STATISTICS with Oracle Connector Stage
Replies: 3
Views: 2497

How to do a COMPUTE STATISTICS with Oracle Connector Stage

Hi all, I was wondering how to perform a 'COMPUTE STATISTICS' with the brand new Oracle Connector stage. As I can see, it's available in the 'old' Oracle Enterprise Stage but not in the new one. Is that automatic? Or is it the 'Index maintenance option' that is doing the job? I'm doing a bulk load w...