It's false. Consider f(x) = 1/x. This function is both continuous and decreasing on [1, ∞), and has a limit of 0 as x approaches infinity. But the integral diverges.