The verb tense that should be used in the second part of the sentence is the past perfect as it makes reference to an action that started in the past (the movie had begun) before another action also in the past (by the time we arrived).
The past perfect is formed by the auxiliary "have" in the past (had) plus the past participle (begun).
