The sentences "You let things more like feathers regulate your going and coming" use the imagery of feathers floating about, aimlessly carried by the wind, to describe Willoughby's free spirited behavior. It implies that he goes wherever he wants, freely following his impulses and whims. Therefore, the narrator mentions feathers to express that the character does as he pleases.
