I am not sure with the answer "Unless the adverb phrase or clause comes before the main clause which I highly doubt than you do not need any punctuation."
have a great day!!!
In spite of her rain-soaked clothing and appearance, it seemed to me that she had never looked lovelier.
Answer:
around a quote / dialogue