Search found 144 matches

by sam334
Thu Aug 28, 2014 1:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fixed Width Length
Replies: 4
Views: 4416

Fixed Width Length

All, Have a question on fixed width length file. The file has 30 columns. The last column has 12 bytes. So, we put Char(12). In the file there some records which have 11 bytes. So, if we checked suppress row truncation warning, its rejecting some records. If unchecked its aborting on the row where b...
by sam334
Thu Aug 21, 2014 8:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

Sounds like an ideal candidate for looping in a Transformer stage. Search for the next nn:nn:nn pattern, which signals the start of the next line. Or maybe search for the next colon character and parse around that. Any help on looping structure of the data? I am kind of confused on how to break it ...
by sam334
Wed Aug 20, 2014 9:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Adding Customerid to each parsed row.
Replies: 1
Views: 2870

Adding Customerid to each parsed row.

All, I have posted this before and successfully parsed the data as shown below. Customer_id, Interaction_data Adam, 12:10:07: Dialing12:10:07: Connecting12:10:07: ABC: abc:9433769781$100.88.77.0:878712:10:07: ABCD: 000012:10:07: Agent Initializing12:10:18: On Call12:10:18: Assigned to operator12:10:...
by sam334
Wed Jul 30, 2014 9:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9269

Okay. Thanks Craig. It worked. Awesome..
by sam334
Wed Jul 30, 2014 8:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9269

Craig, Let me understand the design.

Currently, the design is
ODBC------
FTP Stage- Tranformer- ODBC

Reference odbc is same as target odbc where it updates old records and insert new records.

you want me to add one more link to update the records of lookup succeeds correct?
by sam334
Tue Jul 29, 2014 10:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9269

Thanks for such a valuable information Craig and Ray. I can actually create another job to update the rows whenever there is a change record. But lookup is always better. Will let you know if I have any issue. For now workaround.....Thanks again.
by sam334
Mon Jul 28, 2014 1:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9269

Thanks @bharathappriyan. which functions should I use, like

I need something that will update previous row's end date to yesterday's date (from default date) if the employee change the department and new record comes from source data.
by sam334
Mon Jul 28, 2014 11:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9269

Update previous records with yesterday's date

All, Need a help on updating previous records with yesterdays date. We have table Employee detail, where we have employeeid, department, start_date, end_date. Sam, IT, 2014-07-25, 12/31/9999 Now, when the employee change the department, it should update the end_date to yesterdays date and insert sta...
by sam334
Mon Jul 28, 2014 11:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

Craig, I found a previous post with the code. Trying it. Thanks.
by sam334
Mon Jul 28, 2014 8:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

OK.Thanks Craig.
by sam334
Mon Jul 28, 2014 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

All, Have one more question. Can we convert a :SPACE delimiter to just pipe or any other delimiter. I am trying to use convert function in transformer, but not sure if COLONSPACE together can be converted with other delimiter. As an example, 12:10:07: Dialing 12:10:07: Connecting I want to replace :...
by sam334
Thu Jul 24, 2014 1:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

One way I found is, in server job sequential file stage there is a UNIX style (LF) Line termination. Which eventually breaking it to multiples lines.

So, from SEQ-Transform-Seq-Tranform-Seq,-- I can break one line to multiple.
by sam334
Thu Jul 24, 2014 11:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

That's true. We wanted to have atleast one delimiter. But the source table is a stand alone table so they cant change it. I am trying to break it in SQL server using common table expression. Lets see if it works.
by sam334
Tue Jul 22, 2014 10:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parsing of Data
Replies: 10
Views: 4294

Parsing of Data

Hi all, I have posted some part of this topic before.Not sure how to go with parsing of data. I have a single column Varchar(2000). I want to parse the row into multiple rows. Column looks like, 12:10:07: Dialing12:10:07: Connecting12:10:07: ABC: abc:9433769781$100.88.77.0:878712:10:07: ABCD: 000012...
by sam334
Tue Jul 22, 2014 9:06 am
Forum: General
Topic: Adding Multiple script After job Sub Routine
Replies: 8
Views: 2636

Worked.... Thanks a lot everyone. Appreciate your help.