It's not necessarily true that changing from 4.10 to 4.56 will reduce fuel mileage, and if it does, it will be minimal. There are relationships between the transmission and differential ratios and engine RPM that should be (reasonably) maintained. The drive train is designed to operate most efficiently in a RPM band. The change in tire diameter is about 5.4 % (ratio change from 4.10 to 4.56 is about 10%). Fuel efficiency is one concern. Drive train stress, tire weight and footprint are others that contribute negatively.
You’ll not notice over the many miles, but there is additional wear to transmission and differential bearings occurring, as well as additional heat generated due to more torque converter and clutch slip.
You probably do notice a reduction in acceleration and the shift points are a bit different. To the extent that you respond to the reduced acceleration (i.e., more throttle), there is more drive train stress – that energy has to go somewhere, and during the increased time to accelerate, it’s pent-up in the drive train, and not moving the vehicle (poor for fuel mileage).
All in all, the additional shifting and wear, and the loss of acceleration are reason enough for me to regear. Of course, the tire diameter change of 5.4% and the ratio change of 10% results in a 4.6% over correction – more acceleration and higher RPM at a given speed and gear combination. This may reduce fuel mileage a bit, but towing will improve. Choices …