if the prison represents the harsh justice of the Puritan, which it does, then that surprising rosebush represents kindness and forgiveness. Prison is a place of sin, and darkness so the beauty of a wild rose bush growing in such a odd place, symbolizes god's grace.
