At the waterfall within the Plantation Quest the wiki says that bringing a climbing kit should stop the energy drain and accuracy debuff.
I can confirm that having a climbing kit doesn't negate the energy drain (Even after the quest is complete).
I don't know if it actually negates the accuracy...