Problem with pocket lining and front panel

I am just starting this project. I cut out all pattern pieces for a size small. When I align the curves of pocket linings with the curves of the front panel, there is about an inch of fabric left above the pockets on the front panel. (Please see picture). If I align the top of the pocket linings with the top of the front panel, the curves don't match. What should I do?