What to do with my mom's backhanded compliment?

The only question you should ask yourself is if you like it. If you like it that's all that matters. You can't please everyone so just focus on yourself. Its not being selfish.