It's quite common for people to be allergic to celery so maybe that's what's causing the problem in your mouth. I think, though, it's probably just that it has a strong flavour with no sweetness in it.
I, obviously, dice with death (anaphylactic shock, at least) when I eat it as I like to spread it with peanut butter.
