There's a CSS rule for
.answer-votes.large that is applied to answers whose vote total is somewhere above 34. That rule applies a
padding-bottom property that ruins the vertical centring of the vote count number (it also applies a
font-size property, but that one is overridden by a
!important rule later in the stylesheet).
Removing both padding declarations improves the layout. Here's how it looks right now (in Chrome on OS X):
…and here's how it looks with the padding declarations removed: