Material for Belgravia Knit Dress

I am thinking of making the Belgravia knit dress in a stretch velvet. I am concerned that the nap won't work well for the pattern. Has anyone else tried velvet with this pattern?