Geneva shirt neck line issues

Hi, I've made the Geneva top twice in different cottons and really love it! I've started a third in tencel and am having trouble with the neckline at the shoulder seam. It puckers! Could it be I pulled the facing too tight? I re-did and the second attempt was better but still not great. Pics attached. Any suggestions?