Beat together the sugars and oil. Add the eggs and beat until light.
Add the pumpkin and beat until mixed in.
Stir together the baking soda, cinnamon, nutmeg, salt, and flour. Add to the pumpkin mixture alternately with the milk. Spoon the batter into a greased and floured 9x5 baking pan.
Bake for 70 minutes. Do not over bake. Remove and let cool in the pan for 15 minutes. Flip out onto a wire rack and cool completely.
Place the butter, sugar, and milk in a small saucepan. Bring to a boil. Boil one minute.
Whisk in the powdered sugar and vanilla until smooth. Let cool.
Place the bread on a wire rack over a pan. Spoon the glaze slowly over the top. Top with pecan chips.