East Bay Trading Company near the old slave auction grounds is where I had the best filet of my life.
+1. This whole area is packed with restaurants. Tommy Condon's is a great Irish Pub. Good food, good spirits. Lots of places on/around Market Street. Have fun.