Payment history. This, along with public records (see below), generally accounts for approximately 35% of your score. A record of late payments on your current and past credit accounts will typically lower your score. Being consistent about paying on time can, over time, have a positive impact on your score.