Whenever you try and simplify how people speak, it's just hard to squish them into a simple rule. Language doesn't work that way.