Nope. If you full vote at 85 % , you will be left with 83 % but that 2 % will be recovered in 2.4 hours and you will have 85 % again. You can vote before going to sleep and have 6 % recovered in the morning. Keeping VP above 80 % is wise, especially when you have high SP.
Use Busy.org to vote because there you can adjust each vote.