The Committee Chairman is customarily the ranking majority member in order of appointment. Seniority on a committee is not based on the longest-serving member of the House but on their order of appointment to that committee by their respective party meeting. The Majority party also determines, in consultation with the minority, how many members a committee shall have, and the proportion of majority-minority.
