Depending on the type of computer, we don't use binary. Analog and mechanical computers can express more than two values.
The electronic computers that we commonly use are electronic digital computers. Digital computers use binary. That way it's simple, if there's no voltage that's considered logical 0. If there is voltage it's considered logical 1.