Does it hurt to punch someone in the face?

does it hurt or no?, i am pretty good a walkin away from fights (have been punch in the face a few times, it didnt make me move tho), and when i get piss off i would always punch a hole in the wall.. but right now my dad is drunk (again) and startin ****, and yes i am bigger then him lol hes like 5'6 140pounds and old lmao hes a drunk, and im 17, 6'4, like 170pounds. he always gets n my face and tell me to hit but i dnt ill jst push him back on his *** and stuff. does it hurt to punch sum1..