Yeh, I mean, I’ve been using in ear style headphones since I was in my teens, so it never bothered me.
I do keep some isopropyl wipes (like you get before an injection at the Dr’s office) to clean them up occasionally and I’m not shy about washing them with soap and water in my hands.