DSXchange

Dale,

I am glad you got the Netezza connection working....Would you please tell us the steps you took to get this working...This way we can save the many trials and errors that you faced during the process.

Thank you,
NK

Visual Studio 2005 should work. I recently tried Visual Studio 2008 on 8.0 and it didn't work. I switched it back to 2005. You can download Visual C++ 2005 edition. You don't have to pay for it. 1) Install Microsoft Visual C++ 2005 Express Edition http://msdn2.microsoft.com/en-us/vstudio/aa700736.as...

Thank you for the message... But the thing is I am dealing with more than 40 million rows in the file and is it advisable to use BASIC transformer in a parallel job. If that is the only recommended solution, then I will have to use it. I have also tried with your solution of using the Transform func...

Nope...That is the challenge...If it says, then it could have been done by using some of the IsValid functions.

There could be any value in the field. The code has to be intelligent enough to figure out it is a date and reformat it to the specified YYYY-MM-DD

Rohit, In my parallel job, I am reading all the custom fields with varchar 50 as the datatype... As mentioned in my previous post, Field 1 can have a date value (20060713) or some other value like (+10) or (5788416)..I would have to determine if that is a date field. In the above example, I will hav...

I have 25 custom fields in the incoming file. The file we get can have date fields in any of the 25 custom fields. It is not defined that Custom field 1 can only have date fields....The fields keep changing for every file... I need to check if the incoming value is a date eg: (20060107) and change t...

Thank You Sean..

I will incorporate this and run it again...But my question still remains -- Why does Parallel job reports successful at the end? It is very interesting to notice that this is not consistent with other Fatal messages. Do we have to get a patch from Ascential?

Database: Oracle 9i Write Method Used: Load and Append Index Mode: Rebuild The problem: Parallel job reports successful completion even though I get messages like this. I do understand that we have to make ControlM and the Shell script which runs the DS jobs robust enough to abend we get the Fatal ...

Sure...Does this file splitter splits the EBCDIC file as per the requirements?

It seems like the Cobol Copy book that we have received is incorrect. The SAS folks gave us that information.

I would be interested in knowing about the option you had suggested...

Thank You

Hi, I would appreciate some ideas in this... Information I have 1) One mainframe flat file in EBCDIC format with account and transaction information. Binary FTPed to the ETL Server from Mainframe. 2) Five cobol copy books (including the Header/Trailer copy book) 3) There are too many columns in each...

EE needs to know how file is divided into rows and how row is divided into columns. Sequential File Stage can be parallel if reading multiple files(check out the file pattern option) Under properties tab, check the "Number of readers per node" option--The sequential stage can use multiple ...

Arnd, Would you please explain more on this.. Does that mean that if we have three partitions, we will have 2Gb times 3 or the 2Gb file is split evenly in all the three partitions. Thanks, NK Pavan, 15 Million records can easily be held in a dataset. If you still have a file system limited to 2Gb th...

ArndW, The problem is solved....Now the input and output rows match but the warning stays...and it is for all the partitions... I am sure that the final delimiter is the same...Otherwise I wouldn't even be able to see the data..I will try to output in ASCII format and see. These sequential files are...

I am trying to convert a sequential file from ASCII format to EBCDIC format. The jobs runs fine with some warnings. Warning: Import consumed only 107bytes of the record's 109 bytes (no further warnings will be generated from this partition) The actual file has 32181088 rows in it..But the output gen...

You might need to fill in something in the Modify Stage for the nullable source...

For example:

COLUMN:string = NullToZero(COLUMN,0)

Or you can say NullToEmpty....

Refer page 493 in Parallel Developer's Guide