DSXchange

According to this site http://unicode.org/faq/utf_bom.html#gen6, it should be safer to use utf32 since it is fixed to 4bytes long.

Eric

Hi, As I can see there http://en.wikipedia.org/wiki/UTF-16 , utf16 is still a variable length encoding, so you migth end up having the same kind of problem. Of course, it will be ok if you only have characters encoded on one 16bits "code unit" and not two. At least that's my understanding ...

Hi, I would suggest you to implement your previous script logic into a job control so that you can execute jobs as if they were in a pool, instead of having them in several serialized chains. You can loop on you job list, run them until an increment tops your limit, them release the loop to next job...

Hi, I know it won't help that much, but I faced the same problem on version 8.1 two years ago (only that my job failed instead of processing partial data). I didn't found any info on this, should have raised a PMR on this but didn't had time for it. Here is my old topic: http://dsxchange.com/viewtop...

Hi, I agree that xmeta should not be purged manually without support agreement. Sometimes the xmeta growth is due to poor autopurge settings/lots of warnings thrown/lots of job runs/too many debug options activated, and it seems that 8.1 (version previously given in the thread before split up) was v...

Hi,

You can purge the table up to the date you want to keep logs. Obviously the respective logs will be removed from the director and you will only see the ones you kept.

Eric

Hi, I don't know if you tried to use the "Restrict memory usage" option in the sort stage? You could give a higher value in order to reduce the amount of data landing on discs. Did you check the job score to verify if no inline sort is inserted automatically at runtime? Also verify the i/o...

Hi, First, you cannot use UTF8 for a fixed file. UTF8 is not a fixed length encoding (using 1 to 4 bytes for a character). Your final_delim for instance is encoded on 2 bytes, while other ASCII characters are encoded on 1. You should provide another encoding (or convert the file) See this technote f...

Hi,

In addition to the folder stage in container proposed by Craig, you can use a custom PX routine to do the split (that's what I use successfully).

Check those threads :
viewtopic.php?t=145412
viewtopic.php?t=114531

Eric

Hi,

In addition you can check this blog post which is very instructive on development time estimation.

Eric

Hi,

Is this related to this apar?
http://www-01.ibm.com/support/docview.w ... wg1JR37209

Eric

Hi, I guess you are looking for that kind of documentation : technote 1459416 . I didn't found an updated version, but for example null handling has changed between 8.1 and 9.1 (in stage variables etc.), and some functions do not behave like in 8.1 (see the documentation about isvalid and its variab...

Hi,

As I understand it, the sequential file stage is applying a "cat" (abbreviation of concatenate) command line to the file pattern, which means it concatenate all files matching the pattern into one stream. This is why it can't handle the header in each file.

Eric

Hi, When you open the db2/oracle connector, click on the DB picture on the right upper corner (not on the links), then you should see an option Record Ordering (All records by default), where you can modify the order of load (link by link or row by row in for each link). Of course you have to check ...

Hi, I guess you can do it that way : -activate both ouput filename in one column & row number in one column output -hash on filename&sort on filename&row number in a transformer, then use variable logic to get rid of the first line, like below svIN=filename svTestFirstLine=if svIN<>svOLD...