Rear mud guard rubbing into swingarm

The rear mud guard that protects the rear shock from mud sprayed by the wheel is rubbing into my swingarm. The constant vibrations and bumpy driving I guess has caused a relatively big area where the paint has already been rubbed off and a slight groove is starting to form. And this is only after 5000 miles

[img][/img]
[img][/img]

To try to prevent even more damage I have taped a piece of very smooth cloth on the mud guard on the area it touches the swingarm. Do you think this could stop or at least improve the situation?
[img][/img]
[img][/img]

if it continues like it is now in 20,000 miles there is going to be like a 1cm deep groove in there

I noticed that too but I do not think that it is a big deal. If I was worried about it I would put a layer of JB Weld on the spot on the swingarm and wait until that wears through.