The error message says it all. You are out of space. You need to increase your scratch disk space or use a join stage instead. What is the volume of the data the job is processing?
The easier part is to request for additional space from your System Admin. To remove the old files from the Datasets you need to be careful so that you do not remove any descriptor files that actually belong to other datasets within your project. One approach can be, you can start looking at how old the files are in the Datasets directory and then make an educated decision after talking to the required people rather than just go in and delete those files.
This out of space error refers not to disk space, but to available memory for the lookup file set.
Try to reduce the memory needed in the reference data:
- remove unnecessary columns
- declare all string as unterminated ones, removing the length definitions; since a value of "Hello" in a VarChar(32) takes 26 bytes and with a VarChar() definition will only take 7.
Alternatively you can go the configurations folder in /opt/IBM/InformationServer/Server and change the mount names to the ones which have space left in default.apt (if your project uses some other apt file then use that)
</a>