Make sure you pay every bill on time, every time. Your payment history accounts for 35 percent of your credit score. If you have trouble keeping your bills in order and staying organized with payments, set up electronic billing and payment reminders to stay on top of your bills.