stick to one's knitting

verb1

1. •
   To concentrate on one's own tasks, affairs, area of expertise, etc., especially in order to avoid distraction, embarrassment, or other needless problems.

   • [A]s sportsmen I think that we should stick to our knitting and not allow economic or social conditions to interfere with the Olympic Games. — 1935