Answer:
The first choice: [tex]a = 1[/tex], [tex]b = -1[/tex], and [tex]c = 2[/tex].
Step-by-step explanation:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 1 & 1 & -1 & -2 \cr 1 & 0 & -3 & -5\end{array} \right][/tex].
Add the first row to the second row to obtain:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 2 + 1 & (-1) + 1 & 1 + (-1) & 5 + (-2) \cr 1 & 0 & - 3& -5\end{array} \right][/tex].
Simplify that matrix to obtain:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 3 & 0 & 0 & 3\cr 1 & 0 & -3 & -5\end{array} \right][/tex].
Divide the second row by [tex]3[/tex]:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 1 & 0 & 0 & 1\cr 1 & 0 & -3& -5\end{array} \right][/tex].
Hence, [tex]a = 1[/tex].
Subtract the current row two from row three:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 1 & 0 & 0 & 1\cr 1 - 1 & 0 & -3 & (-5)- 1 \end{array} \right][/tex].
Simplify that matrix to obtain:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 1 & 0 & 0 & 1\cr 0 & 0 & -3 & -6 \end{array} \right][/tex].
Invert the signs in the third row and divide it by [tex]3[/tex] to obtain:
[tex]\left[ \begin{array}{ccc|c} 2 & -1 & 1 & 5 \cr 1 & 0 & 0 & 1\cr 0 & 0 & 1 & 2 \end{array} \right][/tex].
Hence, [tex]c = 2[/tex].
Subtract two times the current second row from the first row to obtain:
[tex]\left[ \begin{array}{ccc|c} 2 - (2 \times 1) & -1 & 1 & 5 - 2\times 1\cr 1 & 0 & 0 & 1\cr 0 & 0&1 & 2 \end{array} \right][/tex].
That simplifies to
[tex]\left[ \begin{array}{ccc|c} 0 & -1 & 1 & 3\cr 1 & 0 & 0 & 1\cr 0 & 0 & 1& 2\end{array} \right][/tex].
Subtract the current third row from the first row to obtain:
[tex]\left[ \begin{array}{ccc|c} 0 & -1 & 1-1 & 3-2\cr 1 & 0 & 0 & 1\cr 0 & 0 & 1& 2\end{array} \right][/tex].
That simplifies to
[tex]\left[ \begin{array}{ccc|c} 0 & -1 & 0& 1\cr 1 & 0 & 0 & 1\cr 0 & 0 & 1& 2\end{array} \right][/tex].
Invert the signs in the first row to obtain:
[tex]\left[ \begin{array}{ccc|c} 0 & 1 & 0& -1\cr 1& 0 & 0 & 1\cr 0 & 0 & 1& 2\end{array} \right][/tex].
Hence, [tex]b = -1[/tex].
[tex]\left[ \begin{array}{ccc|c}1& 0 & 0 & 1 \cr0 & 1 & 0& -1 \cr 0 & 0 & 1& 2\end{array} \right][/tex].