Search found 103 matches
- Sun Jul 10, 2011 3:33 am
- Forum: General
- Topic: DSSetServerParams problem (dsapi w/ c++)
- Replies: 1
- Views: 3058
DSSetServerParams problem (dsapi w/ c++)
edit: corrected sample code to show actual DSSetServerParams( ) I was using. I'm running datastage + client on a virtual machine: ds 8.5 fixpack 1, Windows Server 2008 (64 bit). Summary: Using C++ I can call connect with DSGetProjectList( ) provided I don't use DSSetServerParams( ); I'd very much li...
- Tue Jun 07, 2011 11:38 am
- Forum: General
- Topic: Performances Tuning Tips
- Replies: 12
- Views: 7463
Re: Performances Tuning Tips
Jobs are quite complex in terms of functional requirements, thus it leads to complex jobs with a lot of aggregations, sorts, lookups... That is an interesting problem; please post what you end up doing. Suggestion: job start up times took a hit with version 8 when using dsjob or dsapi to do it; it ...
- Wed May 04, 2011 12:16 pm
- Forum: General
- Topic: making a job to run infinitely
- Replies: 7
- Views: 2736
Sounds like a job for sequencer...
Hi, first time i want to run this job using script or manually . After that, regardless of the result of the run(it may return 1,2,or 3), the job has to run again and this loop should be repeated. Is it possible to achieve this in datastage without using any schedulers like crontab or TWS? Have you...
- Tue Apr 19, 2011 11:59 am
- Forum: General
- Topic: Blueprint Director unable to locate DataStage client
- Replies: 7
- Views: 5681
connected ok after 8.5 fixpack 1 update
After updating 8.5 fixpack1 on InfoServer ( fixpack_FP1_IS85_windows_8500.ispkg ) and Blueprint Director Client fixpack (BLUEPRINT.ispkg ) it still failed to connect. On a whim, just before trying a standalone vm to see if that connects, I tried re-installing Blueprint Director. It wanted a differen...
- Mon Apr 18, 2011 9:10 pm
- Forum: General
- Topic: Blueprint Director unable to locate DataStage client
- Replies: 7
- Views: 5681
connected to metadata workbench 8.5 but not datastage 8.5
Another data point: I just upgraded to 8.5 fixpack 1 and was able to connect to metadata workbench 8.5, but not the datastage engine 8.5. I haven't tried connecting to other datastage versions yet. note: All of tiers and clients are running on the same machine (just a test vm: win2008 64-bit, sqlser...
- Mon Apr 18, 2011 12:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Execute many SQL statements
- Replies: 2
- Views: 3301
copy stage + connectors? Re: Execute many SQL statements
If the statements don't need to be ordered, you could use a copy stage to feed the same data to multiple db-connectors: e.g. 1 statement per connector. By the way, how many sql statements is "many"? 10? 500? 1,000? More? And what kinds of statements... Lots of insert statements? Or conditi...
- Mon Apr 18, 2011 11:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How can I increase the rows/sec while running the job
- Replies: 6
- Views: 7187
Re: some basic background questions
hi...well its simple job with one to one mapping with over 56k records...the source and target are both sql server...with only one source table and one target table Over 56K records? So more than 56,000 records but less than what... 57,000 records? At 10/second, that gives you 5,600 seconds; so it ...
- Mon Apr 18, 2011 10:23 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How can I increase the rows/sec while running the job
- Replies: 6
- Views: 7187
some basic background questions
I'd suggest starting with telling us how your host-computer doing. If you're already running at 100% CPU utilization, it may be time for a hardware upgrade (I see you're on windows, so I suggest that you start with googling "task manager"). Next, I suggest you say a little about your job d...
- Wed Apr 13, 2011 12:32 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Divide data in connected groups
- Replies: 4
- Views: 2880
Smells like graph theory...
"the only thing we have to consider" Sounds like you have it solved already :-) Your example reminds me of an in-order tree traversal. Here's the original data, reformatted a little - it was kind of noisy (I stripped zeros & the ABC XYZ parts, which may not be relevant). Anyway, I find...
- Wed Apr 13, 2011 10:39 am
- Forum: General
- Topic: What makes Connectors bettter?
- Replies: 6
- Views: 3014
Thank you!
Thank you!
Those are some pretty good reasons that I didn't know about.
Connectors sound more robust and more productive for DataStage developers to work with.
John
Those are some pretty good reasons that I didn't know about.
Connectors sound more robust and more productive for DataStage developers to work with.
John
- Tue Apr 12, 2011 10:21 am
- Forum: General
- Topic: What makes Connectors bettter?
- Replies: 6
- Views: 3014
What makes Connectors bettter?
note: Job Type actually for both Server & Parallel jobs. note: OS Type actually for Windows & Unix. ("All Of The Above" not an option in the Job Type & OS Type lists :-) ) So I was RTFM'ing about Connectors (excerpt below) and I started wondering why IBM claims that Connectors ...
- Tue Jun 29, 2010 3:39 pm
- Forum: General
- Topic: slow DSFindFirstLogEntry (2 to 3 minutes)
- Replies: 1
- Views: 995
added 60-day limit Re: slow DSFindFirstLogEntry
So far the only ideas I have had are: 1) Maybe put an arbitrary limit of 60 days on "find first log entry" Well, adding a 60 day limit doesn't seem to makes no discernable difference. I've noticed I will get a flurry of output for 5 or 10 jobs, then it will freeze again (sometimes for 3 m...
- Tue Jun 29, 2010 11:19 am
- Forum: General
- Topic: slow DSFindFirstLogEntry (2 to 3 minutes)
- Replies: 1
- Views: 995
slow DSFindFirstLogEntry (2 to 3 minutes)
So I want to write a log activity scraper. *Seems* easy enough... Step 1: put together some C code that eventually does a loop like this: ... DSOpenJob() result = DSFindFirstLogEntry() while( result == DSJE_NO_ERROR ) { write info from logevent result = DSFindNextLogEntry() } ... DSCloseJob() Step 2...
- Thu May 27, 2010 6:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Create multiple files without looping
- Replies: 11
- Views: 4833
nice - awk example
nice example, anbuanbu wrote:Unix solutionCode: Select all
awk ' { print > $1 } ' file
Also a Windows solution, since DataStage includes MKS, which also has an awk.
- Mon May 24, 2010 5:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Progress percentages in Log
- Replies: 6
- Views: 3028
"with no elephants..."? *groan*
"with no elephants..."? *groan*ray.wurlod wrote:An ETL design with no elephants is irrelephant.
That was especially bad
Hmm... so if something is irrelephant, does that make it off-tropic?