My Garden looks lovely in summer, but in the winter months I let all the seed heads, dead leaf, and every thing in the Garden die down, I don't do any clean up, because the birds that come into the Garden can find bugs that we cannot see, at the moment we have lots of blue tits darting about.
I do that with my garden too but sometime I do regret it a bit in the spring, when I have all the clean up to do still, the birds have a hard enough time here in the winter so anything to help.