How come the Japanese don't care when I say "Oh my!"?

They give you slack because you're a foreigner,you don't have to apologize. As long as we learn from our mistakes,we don't have to condemn ourselves for them.