The word "You" refers to the reader. The poet does this to create the effect of conversation and confession between the reader and the speaker, thus creating a more personal and intimate narrative, where the reader is part of the story, increasing his involvement and allowing a deeper and more accurate interpretation, already that the reader can feel part of that universe created by the poet.