Stop calling face_text_pos() for faces that don't need to have text in