I read the poem and found that the line with most underlying tones of regret is "<span>Back then it never fell so solemnly"
</span>But now I am mostly at the window watching the late afternoon light. Back then it never fell so solemnly <span>against the side of my tree house, </span> Billy Collins is saying that he previously watched the afternoon light, but in the past it was not as solemnly as it is now.