The page size is fixed for any given page, and the boxes will be used in different ways.
The CropBox will cause the viewer (and printer) to only draw what is inside the Crop - so if you have bleed & trim outside of crop, then you'd lose all the stuff out there. You'd need to have Crop outside...