Halved Intelligence gains just means you have to spam Syri twice as long. It also doesn't impact level up points. +40 Minimum Libido and 2x Libido increases isn't a problem if you're already doing a high Libido build. (Also, most stat decreases don't seem to actually work right now.)
I'd be more concerned with Easy, but that's just me.
If you want to remove it anyway, open the console (F12) and type
pc.removePerk('Drug Fucked')