The "it" Mr. White doesn't want in his home is his dead son, Herbert. Mr. White also tells his wife that when Herbert died, his body was so mangled that he was only able to know it was his son because of his clothing, so it's likely the corpse may not have even been fully intact.
