Search found 48 matches

by varshanswamy
Thu May 12, 2005 10:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Data from Dataset
Replies: 3
Views: 2518

Reading Data from Dataset

Hi, I have data of ten digits say for example 3024410009, I have given the Data Type to be BigInt and the Precision to be 32. I am reading this data in a dataset but it reads it as a negative number. Could you please tell me which data type and whioch precision would be the best for such kind of dat...
by varshanswamy
Mon May 09, 2005 4:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

Re: String Parsing

I have problem here, if there are 2 ampersands in one string and 4 ampersands in another string it is creating a problem for me, when I read the file in step 2 it is overwritng the first line with the second line, that is I get only one row having Field1 Field2 Field3 and Field4 How do I further use...
by varshanswamy
Sat May 07, 2005 1:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

I am still unable to get the required result through the pivot stage as mentioned, I did try using the pivot stage, in the derivation of the Output Tab of pivot I am uable to get the required result. If I put the value of the key, string in the derivation I get the key in the first row and the entir...
by varshanswamy
Thu May 05, 2005 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

Re: String Parsing

How do I further use the pivot function I am unable to follow. Could you please help on this Hi Varsha, You can use the Convert function to convert all the "&" to "," So after conversion your data will look as follows 1,A=B,C=D,E=F,G=H 2,L=M,G=H Then you can use the pivot to ...
by varshanswamy
Thu May 05, 2005 7:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

Re: Solution

I string is not a static one to be of the format A=B&C=D&E=F, it can also be of the format A=B1234&C=D+1&E=F, so I cant use what you have mentioned please could you help me on the same In Transformer u have the substring function i.e [,],use this function to split the second column i...
by varshanswamy
Wed May 04, 2005 5:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

Hi I was the original participant and I have 2 seperate fields, and I need to read them as 2 seperate fields itself, and I need to implement the solution for and input comma seperated file as follows Field1, Field2 1, A=B&C=D&E=F&G=H 2, L=M&G=H I need to write a job in datastage PX 7...
by varshanswamy
Tue May 03, 2005 1:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential operator cannot preserve partitioning of parallel
Replies: 10
Views: 28471

I would like to know if there are 2 outputs from a single input one output leading to a sequential file other to a dataset, then how is it possible to solve the problem, because the entire partitioning is eliminted
by varshanswamy
Mon May 02, 2005 2:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Parsing
Replies: 37
Views: 14961

String Parsing

hi, I have an input string of the format Field1,Field2 -------------------------- 1,A=B&C=D&E=F&G=H 2,L=M&G=H I need to write a job in datastage to split this string which would be dynamic and have it of the form. Field1, Field2 --------------------- 1,A=B 1,C=D 1,E=F 1,G=H 2,L=M 2,G...
by varshanswamy
Thu Mar 03, 2005 6:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL job aborts
Replies: 7
Views: 4112

ETL job aborts

node_node1: Player 5 terminated unexpectedly.
main_program: Unexpected termination by Unix signal 14(SIGALRM)
main_program: Step execution finished with status = FAILED.

I wanted to know what could be the reason for the failure of these jobs
by varshanswamy
Fri Feb 25, 2005 1:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage
Replies: 4
Views: 2432

I am used an Inner Join as it is based on the dummy column created for the purpose of cartesian product. You didn't state how you were doing the join - presumably a Join stage. No matter what method you use, you're going to have to process a large number of rows (684132000 based on the figures you s...
by varshanswamy
Thu Feb 24, 2005 11:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage
Replies: 4
Views: 2432

Join Stage

I have ajoin which performs a cartesian product between 2 files having a common column called DUMMY which is defaulted to 1. Source File - 2000 records Reference File - 34,2066 records I want to know how I can quicken the process, and also if join can do the operation because of the heavy volume of ...
by varshanswamy
Wed Feb 23, 2005 9:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Lookup Range
Replies: 12
Views: 5481

Re: Lookup Range

Shiv I had a similar problem and I have dealt it as follows, if your job is a server job, here is the solution. The contents to be looked up (reference data) put it into a hash file, make from and till as the keys. In another job access this hash file using a universe stage as the universe stage all...
by varshanswamy
Tue Feb 22, 2005 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Range Lookup
Replies: 16
Views: 6698

I have a single database, the problem why I cant join is there are no keys. But I will still try the outer join. You said you have 2 database stages. Does it imply that the 2 tables reside in separate db or in the same db in different tables? If they reside on the same db, you may be better-off usin...
by varshanswamy
Tue Feb 22, 2005 4:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Range Lookup
Replies: 16
Views: 6698

I want to know one thing how is it possible to filter based on IP_NUMBER >= IP_FROM AND IP_NUMBER <= IP_TO in transformer do you mean adding it in the constraint. Because I would be having a cartesian product now of the records when I join using a "dummy_key". It is much the same in PX. We...
by varshanswamy
Mon Feb 21, 2005 10:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Range Lookup
Replies: 16
Views: 6698

Re: Range Lookup

I have implemented the same by writing a server job and calling it in the form of a shared container in the parallel job. I still need to check on performance. In the server job, I have put the records of the IP_LOOKUP table into a hash file, and later in another job I have used the Universe Stage t...