Think about holding a glass of cold water. Your hand is warmer than the glass. Do the particles in your hand or those in the glass of cold water move faster? Why?
technically usually the warmer object/substances particles move master which causes friction among the particles plus the kinetic energy being converted to thermal energy, so i would say the hand.