This happens because some of them become memory T cells. Memory T cells have become "experienced" by having encountered antigen during a primary infection. Next time when those cells encounter the invader, the immune response is much faster and stronger than the first time.
