Tailored stretch pants with contrast side panel