the reason polyfill will give you a lower response is because it will help to deflect standing waves in your enclosure. it won't eliminate them, but it will help, and w/less standing waves, there is less resonation on the cone, so the driver can use more excursion with less distortion(can play louder, and lower).
you want the perfect enclosure....make one in the shape of an egg.... zero standing waves
