"Absence makes the heart grow fonder" rewritten is just "your presence makes me like you less." Don't be either person in this equation.