When environments change, they usually do so pretty rapidly, at rates with which adaptation by natural selection would be hard put to keep up. When such change occurs, the quality of your adaptation to your old habitat is irrelevant, and any competitive advantage you might have had may be eliminated at a stroke.