Yes, usually when in meetings. It’s 99% a society/conventional thing, but looking and typing on your phone while talking to someone will often be perceived as rude. Taking notes in your paper notebook though usually will come off as being attentive and interested.