Mix interlock with jersey?

I like to turn adult-sized fun graphic tees into new shirts for my little guy using upcycled shirts for the contrasting sleeves. I have a new tee in jersey fabric for the main body, and I happen to have an old shirt of mine in the perfect color for its sleeves. However, my shirt is a fairly stretchy interlock. Think that would cause any issues? Since my guy is a year old and these are fun, mostly-free projects I'm not terribly concerned about longevity of the finished garment, but I'd rather track down a different source of fabric for the sleeves if it will wear unevenly/stretch out badly from the very first wash.