I love cute sexytime accessories, but I absolutely agree with you that dirty clothing can be disgusting. Having lived in a home with five women, two of them younger teenagers, one of them college-aged, and the last two grown adults, I've seen the entire spectrum of discarded intimates, and they can definitely lose their appeal very quickly.
But that's why you aim for living with one very clean woman that respects her home and the others living in it.
I wouldn't really call it a fetish per se, but cleanliness is very important to me in a relationship. I will not suffer slobs, no matter how attractive they might otherwise be.