Search found 33 matches

by Madhavan VM
Tue Jan 08, 2008 3:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting values of User defined environment variables in UNIX
Replies: 5
Views: 3444

Thank you Mahesh! That did the trick.

Thanks everyone who responded to the question. :)
by Madhavan VM
Tue Jan 08, 2008 10:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting values of User defined environment variables in UNIX
Replies: 5
Views: 3444

Hello All, Thank you for all the replies. I think my requirement was not mentioned/understood clearly. Let me restate it. 1. I have defined a variable Log_Dir having value /user/spool/myproject/logdir in the administrator. 2. I am creating a script which is different from the one used to run the job...
by Madhavan VM
Mon Jan 07, 2008 6:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting values of User defined environment variables in UNIX
Replies: 5
Views: 3444

Getting values of User defined environment variables in UNIX

Hello All, My requirement is: To get the value of User defined environment variable for a project in the UNIX box. For e.g.: 1. I have defined a variable Log_Dir having value /user/spool/myproject/logdir in the administrator. 2. I am using this variable in the job and have given the value in job as ...
by Madhavan VM
Thu Nov 15, 2007 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join partitioning requirement
Replies: 1
Views: 836

Join partitioning requirement

Hi, I have to join two datasets based on keys L1 and D1, where L1 is a one up number and D1 is a date. I believe that for the join to work, the input partitioning on links should be hashed and sorted on the keys. My input data is coming as sorted on key L1. Hence, is it possible for me to join on L1...
by Madhavan VM
Wed Aug 29, 2007 2:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fiscal Week and year from Timestamp??
Replies: 7
Views: 1607

I googled for Time dimension, Kimball and didn't get an useful article with respect to my question. Is there a specific key word that i should look in. Thanks!
by Madhavan VM
Wed Aug 29, 2007 2:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fiscal Week and year from Timestamp??
Replies: 7
Views: 1607

Sud,

The solution proposed by you does not work for the dates 2008-1-1 and 2008-2-1, to name a few. I am looking into it if i can fine tune your solution.

Ajith
by Madhavan VM
Wed Aug 29, 2007 11:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fiscal Week and year from Timestamp??
Replies: 7
Views: 1607

Fiscal Week and year from Timestamp??

Fiscal week starts from first week of February. hence 1st Jan 2006 would be of fiscal week 49 and fiscal year 2005. Week 1 starts from 1st of January. I have timestamp as an input field. Here if I am trying to get week from timestamp then what I am getting is week of the year. I have used the below ...
by Madhavan VM
Thu May 31, 2007 1:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting a before-job routine value in a job parameter
Replies: 2
Views: 1002

Could you explain what is the scenario where you need such a work around?
by Madhavan VM
Mon Nov 28, 2005 5:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fatal Error: Tsort merger aborting: stat() of sorted run fil
Replies: 1
Views: 2632

Fatal Error: Tsort merger aborting: stat() of sorted run fil

hi, The job has two udb DB2 tables and they are inner joined using a join stage. The input links to the join are hashed and sorted on the join key. This job was running without any issues for the past one month. But now I got the following error: JoinGst.LkRefDb2udbGst_Sort,0: Failure during executi...
by Madhavan VM
Wed Nov 23, 2005 2:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we handle unstructured data?
Replies: 7
Views: 4074

To add to the above topic can we handle data which resides in picture? what about audio and video files?
by Madhavan VM
Wed Nov 23, 2005 2:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we handle unstructured data?
Replies: 7
Views: 4074

How can we handle unstructured data?

Unstructured data has an unstructured format at the automatic level. The metadata is not defined and the data is unformatted. Data which resides in mails, PDF documents, Microsoft Excel spreadsheets and word documents can be said as unstructured data. Structured data has a known format like char, in...
by Madhavan VM
Wed Nov 02, 2005 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Failed a keylookup for record
Replies: 8
Views: 8844

Hi Senthil, Before running the jobs do the following points 1. For the lookup to work properly in DS 7.5 the lookup keys should be represented as keys. To do this check the key column in the input tab for the lookup keys. ( Bottom left corner, column name, key, SQL Type... check the key column for t...
by Madhavan VM
Wed Oct 19, 2005 7:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage unable to write into the Sequential files
Replies: 6
Views: 4878

hi, The reason is you are writing nulls to a sequential file without handling nulls. That is the reason eventhough the log says 3 records are loaded but you are not able to see any record in the view data nor in the unix side. To handle this, go to the sequential file, format tab, field defaults. se...
by Madhavan VM
Thu Jul 21, 2005 9:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash Partitioning
Replies: 2
Views: 1120

Hash Partitioning

The question is related to partitioning From a copy stage, cpy_split , i am splitting the record into two links. one goes to the Aggregator, Agg_sum , and one pass to a Join stage, Jn_k1 .The link which is passed to the Aggregator,Agg_sum is Hashed and sorted on a Key,say,K1. In Agg_sum we are calcu...
by Madhavan VM
Wed Jul 06, 2005 10:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to assess a DataStage Job
Replies: 5
Views: 3552

How to assess a DataStage Job

hi, How can we assess a DataStage job? For example, In other languages we define jobs as simple, medium or complex depending on lines of code. Or we use the caper jones tables to find the function points. Similar to these lines do we have a standard for rating the DataStage jobs? How do we calculate...