He clearly thinks and stresses over his family and is his most vital ownership. Being in prison gave him a decent favorable position; he had sustenance and a place to rest. He was terrified for his family and realized that they required him and in the end felt remorseful. He truly had all that he required in prison while the family didn't.
