Yep. Once you've fully paid your debt to society, you shouldn't have to keep on paying for the rest of your life. Once your prison term is completed (meaning, if you're sentenced to 20 years, 20 years from your sentencing date, even if you get released for good behavior after 15), and once you've completed any and all other parts of your sentence (restitution, community service, etc), bingo, your full rights as a citizen are restored. You can vote, own a gun, run for Congress, whatever.
FWIW, it used to be the law (in Texas, IIRC) that once a man got out of prison, he was given a horse, a $20 gold piece, and a rifle, all so he could have a chance to start a new life. That's really not a bad philosophy....
