'It was a pretty quiet holiday for them': Ben Affleck and Jennifer Lopez 'really enjoyed' spending Christmas together