Danny O’Donoghue and this Selling Sunset star had a ‘whirlwind love affair’ back in the day