Close reading means that we read something very attentively, paying a lot of attention to it. Ideally, we should also underline important parts and make annotations - so the correct answer is indeed "annotating" - making notes and comments on the text.
