If you call yourself a non-believer, you're referring to disbelief in something, and you're acknowledging that there is something to believe in or not.