The correct answer is:
(a, -b)
Explanation:
A 180° rotation maps every point (x, y) to (-x, -y). This means that both the x- and y-coordinates are negated.
For the point R(-a, b), this means that both coordinates are negated; this gives us R'(a, -b).