Hey there,
Your question states: What federalist policy did president jefferson keep when he took office in 1801?
Well, it was the policy dealing with the Bank of the United States. Thus, this would be something that Jefferson would keep when he took that office in the year 1801.