Points are what your drops earned, plus +50 for every board you topped. Spending credits on votes never costs you rank.