Shall we at this moment justify the deprivation of the African American of the right to vote, because someone else is deprived of that privilege?
The speech is trying to justify and bring to light the need for all men of the united states to have a right to vote, without regard to race.
