Search found 130 matches

by DSFreddie
Fri Dec 14, 2012 9:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compare files - Generic Job
Replies: 6
Views: 3460

Sure Ray, I will plan to take a premium membership.

Anyone can suggest me with some ways to accomplish this.

Thanks,
Freddie
by DSFreddie
Fri Dec 14, 2012 1:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compare files - Generic Job
Replies: 6
Views: 3460

Hi Ray, Thanks for your quick response. As I read ur reply it looks like passing files dynamically & doing a field by field comparison is faesible in Datastage. But, since I am not a premium user, i was not able to read the latter part of your reply. Hope you can help me with some more details o...
by DSFreddie
Thu Dec 13, 2012 11:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compare files - Generic Job
Replies: 6
Views: 3460

Compare files - Generic Job

Hi All, Thanks for visiting this post. I am looking forward to get some thoughts/inputs on a scenario where I need to build a Generic Datastage job to compare 2 files with same layout (field to field comparison) & generate a file similar to below. e.g: File1 File1 File2 File2 Field1(matched) Fie...
by DSFreddie
Fri Oct 26, 2012 6:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector Vs Usage of different stages
Replies: 1
Views: 1047

DB2 Connector Vs Usage of different stages

Hi All, Seek your thoughts on a design. I am trying to retire a MF Extract process which extracts data from DB2 table based on some inner joins with other tables & 12/13 datatype conversions (like CHAR(COALESCE(T.fieldname,' '),7) for a set of fields. Can you pls let me know whether I can put th...
by DSFreddie
Thu Aug 16, 2012 10:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture & Change apply to a dataset
Replies: 3
Views: 1816

Thanks Ray for your inputs :) The change capture/Apply seems to work. The new question that is arising in my mind is on the performance of these stages. In the Full File, we have around 500 million records. The delta file contains 10 million (Daily). I am hearing that the change capture/change apply...
by DSFreddie
Mon Aug 13, 2012 12:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture & Change apply to a dataset
Replies: 3
Views: 1816

Change Capture & Change apply to a dataset

Hi All, I have a requirement where I need to first capture the changed records when compared with a full file & daily delta. (Both are datasets). Also, once the changed records are identified, these records need to be updated back to the Full file to keep it current & up-to-date. Can you pls...
by DSFreddie
Mon Jul 16, 2012 8:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help with Logic - How to split the records into groups
Replies: 2
Views: 1071

Help with Logic - How to split the records into groups

Hi All, I am coding for a requirement where I need to split the input records based on the no:of records with the same value for a Field A. When the no: of records with the same key value exceeds 6, then it needs to split into 2 groups & assign a new group value. That is, if the no: of records w...
by DSFreddie
Thu Jun 07, 2012 7:52 am
Forum: General
Topic: E-mail Notification - Report in the Body of the mail
Replies: 2
Views: 2127

E-mail Notification - Report in the Body of the mail

Hi All, I am creating a statistics report after the ETL cycle run & I am currently attaching this report through the email notification & sending it to stakeholders. Is there a way I can send the content of the report in the e-mail body itself? I browsed through the forum for an answer &...
by DSFreddie
Wed Mar 14, 2012 6:13 am
Forum: General
Topic: E-mail Notification (Attaching a .txt/html file)
Replies: 5
Views: 2513

Thanks for your reply Kryt0n.

Pls note that I am building this report through a LINUX Shell Script. ( & not through Filestage in DS). Wondering whether we can add DOS line terminator in Script level too.

Thanks
Freddie
by DSFreddie
Tue Mar 13, 2012 5:37 pm
Forum: General
Topic: E-mail Notification (Attaching a .txt/html file)
Replies: 5
Views: 2513

Hi Chulett,

Thanks for your reply.

I googled for more info on DOS line terminators, but couldnt find any info on the same. Can you pls shed some light on this.

Thanks
Freddie
by DSFreddie
Tue Mar 13, 2012 9:02 am
Forum: General
Topic: E-mail Notification (Attaching a .txt/html file)
Replies: 5
Views: 2513

E-mail Notification (Attaching a .txt/html file)

Hi All, I am trying to attach a .txt & .html (in 2 different e-mail notification activity). The files look in good format (like below) when i ftp'd & opened with notepad. Process Date : 20120308 Total Adds : 0 Total Changes : 0 Total Deletes : 0 Total Suspects : 6880 But when the email notif...
by DSFreddie
Wed Mar 07, 2012 5:51 pm
Forum: General
Topic: How to derive last sunday's date based on Current date
Replies: 7
Views: 2551

How to derive last sunday's date based on Current date

Hi All, I know my question is more of a LINUX command, but i thought i will check in this forum as I have seen lots of guys around with plenty of Scripting knowledge. Here is the situation: I have a file coming from MF every Sunday & my Master Sequencer runs any date between Tuesday to Friday of...
by DSFreddie
Tue Feb 21, 2012 4:40 pm
Forum: IBM QualityStage
Topic: Maximum Number of Match Passes in Match Specification
Replies: 3
Views: 3112

Thanks for your reply Ray.

Any thoughts from anybody who did experience something similar in QS 8.5 with the maximum no: of match passes ?

Thanks,
Freddie
by DSFreddie
Tue Feb 21, 2012 10:54 am
Forum: IBM QualityStage
Topic: Maximum Number of Match Passes in Match Specification
Replies: 3
Views: 3112

Re: Maximum Number of Match Passes in Match Specification

Further to add, I am using IIS 8.5 version.


Thanks for your thoughts.
Freddie
by DSFreddie
Mon Feb 20, 2012 9:26 am
Forum: IBM QualityStage
Topic: Maximum Number of Match Passes in Match Specification
Replies: 3
Views: 3112

Maximum Number of Match Passes in Match Specification

Hi All, I am trying to understand the Maximum Number of Match Passes in the Match Specification. I have 15 match passes in this match specification, while checking the logs, I could see the Match Statistics is captured only for the first 11 match passes. Is there any limitations on the maximum no: o...