DSXchange

HI! All
Iam running this script for splitting the file in command stage ,attacth a timesatmp to it and then conver it to .tmp extension

cd /home/staff/thussain
Prefix=Z_PRICE_NEW_`date "+%Y%m%d%H%M%S"`
split -3000 -a 5 /home/staff/thussain/Z_PRICE_NEW.txt $Prefix
find . -name "$Prefix*" -print | {
while read FILE;
do
mv $FILE $FILE.tmp
done
}
example out put
Z_PRICE_NEW_20070517014630aaaac.tmp
Z_PRICE_NEW_20070517014630aaaaa.tmp.tmp

but some files are coming with tmp extension twice ,and any on tell me how to resolve this issue..

Thanks in Advance

Regards

Tausif

Please use the following code, which split the files and changes the output file with the required format

TEMP_FILENAME="U_D-1_$DATE_YYYYMMDD"_

TEMP_DATA="NED1_DATA"

##Split the File
split -a 4 $WORKDIR/NED1.csv $WORKDIR/$TEMP_DATA

##Move all the Filename that has been created while splitting into NED1_files.txt
ls $WORKDIR/$TEMP_DATA* > $WORKDIR/EDWLoadExtractNED1_files.txt

i=1

##Attach Sequence to each generated File and rename the File to the required format

for FILE_NAME in `cat $WORKDIR/EDWLoadExtractNED1_files.txt`
do
j=`echo $i |awk '{printf "%04ld",$1}'`

FILE="$TEMP_FILENAME$j"

mv $FILE_NAME $FILE

i=`expr $i + 1`

done

regards
Magesh S

But what is the issue with the existing script ,it work fine when the file is is smaall,its is throwing this issue only whenthe file is big..

I have tested your script with 20000 rows its working fine, can you tell how much big is ur file

Magesh S

Why is this on a DataStage forum?
Ought it not to be on a UNIX or shell scripting forum?

The file which is causing the issue contains 700000 records..

That's not many, unless each is Megabytes in size.