Adrienne Maloof opened up about the hardest part of empty nesting now that all three of her children are out of the house in an exclusive conversation with PEOPLE at her holiday party benefiting Children’s Hospital Los Angeles.