State File Demystified

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rameshrr3
Premium Member
Premium Member
Posts: 609
Joined: Mon May 10, 2004 3:32 am
Location: BRENTWOOD, TN

State File Demystified

Post by rameshrr3 »

The State file is a binary data file that stores an uint32 or uint64 value depending on your operating system. in a 64 bit platform , it stores an uint64 value in each 8 byte block of data per node. To read current values of a surrogate key state file , you can use the unix command od -xc <state File name> or use a sequential file , whose schema has a single uint 64 column [BigInt unsigned , unbounded, Data format=binary, field width = 8] , with Format property record type as implicit , you can see the currently stored values using view data. Not sure if this will help anybody or can be of much use , but my attempt to demystify those mysterious state files and their 'garbage' data.
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

Great! :D Going to try it first thing when I reach office. Thanks for sharing.
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It seems you have set up your state file with a block size of 1.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply