DSXchange

So we were finally able to fix this, i am outlining the steps we did:
1) Read the columns with hex values with Extended property "Unicode".
2) Used the Seq and SeqAt functions to convert the values from EBCDIC to ASCII.

The file was downloaded as binary from the mainframe server.

Cheers!

Tried to read the file using the sequential file stage and defined similar properties as the CFF with EBICDIC as character set and binary. The special characters occur like {0c}, {d1} etc. when i view the data via Designer. But when running the job, the job aborts giving a short read error, the job ...

Thanks for your response Franklin. I tried to read this attribute as Binary, but it threw an error in the very next attribute on the copy code. This attribute was being read ok with decimal values with the original copy code when the problematic column was read as PIC X(1). This next column is defin...

Thanks for your response Franklin. I tried to read this attribute as Binary, but it threw an error in the very next attribute on the copy code. This attribute was being read ok with decimal values with the original copy code when the problematic column was read as PIC X(1). This next column is defin...

Hi - There is a mainframe file that we copied over to our unix server (using binary mode). When trying to read the file in datastage, some columns show as special characters. When we asked our source about it, they said these columns are defined as hex on their side. For eg: they see the value of th...

Hi - There is a mainframe file that we copied over to our unix server (using binary mode). When trying to read the file in datastage, some columns show as special characters. When we asked our source about it, they said these columns are defined as hex on their side. For eg: they see the value of th...

Sorry this may sound naive..but from what you suggest. If i use auto partitioning shouldn't DS know which way to partition the data is the most efficient one? How does defining hash partitioning explicitly going to help?

Hi -

Say there are 5 key columns used to do the join. One of those columns has null value from the source as well as the reference table. The other four columns have matching values.

Will a lookup be found in this case? (no null handling is done) or will the job abort or throw a warning etc.

My observations for this were very unusual, the original job when renamed with a suffix and compiled and rerun the record count was exactly the same as the copy job. When the job was renamed to the original name and rerun the count was again exactly the same as the copy job. Atleast the count with b...

Hi - There is a scenario in one of the new requirement of our project: The input stream has columns COLA and COLB, COLB is the key column. The reference link has COLB and COLC. I want to do a left outer join based on COLB but COLB has duplicate entries in the reference link. The values for COLC are ...

Found something really weird during the testing, the job i was working on filters the record based on the checksum. It basically checks after the sort if the checksum for the record is equal to the previous value, if not then it sends the record to the output file. If i create a copy of the job, com...

Thanks Ray, i checked the output link and RCP is not enabled, i will test this fragment of the code with smaller dataset over the next couple of days.

Will let you know what i find.

Hi - I have a job that does a check sum on certain columns. The stage property has the "Use all columns except those specified" and some columns are defined in the "Exclude Column" list. As part of a change request i have to by pass a couple of additional columns but i don't want...

Hi ,
I have the job like ....
seq. file.....>transformer......>dataset

I want to count the number of records coming from the source .How can I do that in the transformer stage .

P.S :I don't want to use DSgetlinkinfo() and Aggregator stage or any script

Hi , I have a parallel job with the source as a dataset .A field AMORT_DT is coming as VARCHAR from the input and is being converted to Date in the transformer . After the lookup I want to check the converted Date field for Empty field (i.e '') I think '' is not a valid date type . Is there any othe...