Victor definitely considered himself responsible for their deaths. He carried a heavy weight of guilt on his shoulders for the deaths and so much so that he made himself sick. I believe that one of the driving forces in Victor's pursuit to kill the monster was guilt, along with anger and grief.
