What do you do when your father invites extra guests?

Having a birthday party for a toddler and my father invited someone i barely have seen before , the party is at my father's. Should i just not do the whole party there and reschedule or go along with it. I really don't know this man and i was hoping for a family only event, What do I do?