It's not easy to read that type of data in PX (or in Server). Make the data as flat as you can and preferrably fixed width prior to importing into PX. Then, tag each incoming row with an indicaor that specifies the format of each row, and use corresponding schemas to parse the row.
- BP
Search found 180 matches
- Thu Jan 22, 2004 10:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to read a complex flat file??
- Replies: 2
- Views: 3556
- Thu Jan 22, 2004 10:11 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Connection problem!
- Replies: 5
- Views: 3355
Connection problem!
ld.so.1: dscs: fatal: libUtilWSClient.so: open failed: No such file or directory I think the above line is your main problem. If this is a DataStage library, then you might need to reinstall DataStage. The library might have been corrupted during the install, or perhaps on the install disk. If it is...
- Sun Jan 18, 2004 6:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to map file Error
- Replies: 13
- Views: 8546
Unable to map file Error
How did you create the dataset? Is it created by an upstream PX job? There is a utility called orchadmin that can be called thru the UNIX command line. You can use it to check the status of a .ds file. It has been described in other posts. If orchadmin has trouble with the .ds, then the problem isn'...
- Wed Jan 14, 2004 8:18 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Inner Circle Experts Design Dilemma
- Replies: 13
- Views: 5670
Inner Circle Experts Design Dilemma
I don't know much about the PX CDC stage, but isn't this what it's supposed to do? It sounds like he's trying to implement a slowly changing dimension, right? PX can be used to do large lookups if the lookup table on the database is partitioned. PX can instantiate a separate reader per partition. -BP
- Wed Jan 14, 2004 8:07 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Is there a function to convert a string into a number ?
- Replies: 6
- Views: 2777
Is there a function to convert a string into a number ?
PX is not freely-typed b/c it doesn't operate on DS's Basic engine. It uses a separate c-based engine.
I don't know the answer to the original question, but if someone has the APT_Ref cards, could they be kind enough to see if there is a str_to_num function for the APT_String class?
Thanks,
BP
I don't know the answer to the original question, but if someone has the APT_Ref cards, could they be kind enough to see if there is a str_to_num function for the APT_String class?
Thanks,
BP
- Wed Jan 14, 2004 7:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Use of C++ compiler in promotion process
- Replies: 14
- Views: 12015
Use of C++ compiler in promotion process
It seems like you have a link-loader problem. Using the environment vars you set for the bin and lib within PX, you should be able to compile a simple c program outside PX. If that doesn't work, then you have set up your env improperly within PX.
-BP
-BP
- Wed Jan 14, 2004 7:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: did you know? You can create a unique index in parallel
- Replies: 29
- Views: 24936
did you know? You can create a unique index in parallel
You are gauranteed uniqueness if you use the technique above for generating a surrogate key. You are not gauranteed that there will be no blanks, which is not a problem - as Ken points out - if you don't assign other meaning to the surrogate key besides uniqueness.
- BP
- BP
- Mon Jan 12, 2004 1:44 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: CHECK LIST TO MAKE SURE DS SERVER /PX SERVER & env WORKS
- Replies: 6
- Views: 3768
CHECK LIST TO MAKE SURE DS SERVER /PX SERVER & env WORKS
I believe that there are some sample 'osh' scripts that come with PX. You could run them to make sure that the PX server is set up correctly. Also, always test a simple buildop with PX to make sure that your C compiler is compatible with your PX env.
-BP
-BP
- Mon Jan 12, 2004 1:36 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to map file Error
- Replies: 13
- Views: 8546
Unable to map file Error
Try running with a one node config. If that works, then the problem is with the partitioning.
Are the partition methods for both data sets set to 'clear'?
- BP
Are the partition methods for both data sets set to 'clear'?
- BP
- Sat Jan 10, 2004 7:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Communication Resources problem
- Replies: 2
- Views: 2017
Communication Resources problem
You could be running out of disk space or memory. To check disk space, do a ds -k . in the directory that holds PX temp and permanent files. To check memory, run top while PX is running and make sure you have ample swap space.
- BP
- BP
- Sat Jan 10, 2004 7:07 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to map file Error
- Replies: 13
- Views: 8546
Unable to map file Error
Does that file exist? If not, you may need to recreate the dataset it is trying to access.
-BP
-BP
- Mon Dec 29, 2003 12:56 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to configure DB2 remote database in PX environment
- Replies: 3
- Views: 1504
How to configure DB2 remote database in PX environment
Do you have the administrator's manual for PX? Setting up DB2 for PX is different than setting up DB2 for DataStage Server. After reviewing the manual, please write back.
- BP
- BP
- Fri Dec 19, 2003 10:56 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Removing all instances of duplicates
- Replies: 6
- Views: 2109
Removing all instances of duplicates
You just need a transform and another filter/transform.. First hash and sort by the dup keys. Then use one transform to assign a sequential # to each record in a dup group. Then in the second transform/filter, use the sequential # as a constraint/filter: if the # = 1, then that's the record to retai...
- Wed Dec 17, 2003 10:11 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: APT_ParallelSortMergeOperator: Error
- Replies: 12
- Views: 7712
APT_ParallelSortMergeOperator: Error
If you look through the director log for that job, you should be able to find a reference to the right directory.
-BP
-BP
- Tue Dec 16, 2003 12:54 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: APT_ParallelSortMergeOperator: Error
- Replies: 12
- Views: 7712
APT_ParallelSortMergeOperator: Error
It should be in the RT_BP(??) directory that is created on the server for that particular job.
-BP
-BP