To me his words mean that although he may have been racing against people with more experience, he didn't feel at a disadvantage. He felt as though he was their equal, because age doesn't always matter.
"converse" in this context means "a situation, object, or statement that is the reverse of another or corresponds to it but with certain terms transposed."