Outcasts may grow up to be novelists and filmmakers and computer tycoons, but they will never be the athletic ruling class.