Why did my face swell?

Hmmm. It does sound like an allergic reaction. Maybe you didn't take enough benadryl. Or maybe the benaryl you took did help it from getting worse that you could imagine! I guess some sort of insect bite could have done it. Were you in a high elevation? Just be glad it's gone & hopefully won't reoccur!