Two places that I can recommend from personal experience and more than one visit are Pierpoint on Aliceanna St. in the Fells Point section of town. Nancy Longo is the chef/owner and does a tremendous job with Maryland cuisine. Her smoked crab cakes are not to be missed. The other place that I have enjoyed recently is Donna's in the Mount Vernon section. Her cuisine is what might be called new Italian. Also, I would recommend for a very casual lunch the crab cakes at Faidley's in the Lexington Market, considered by many, including me, to be the best in the city.
Baltimore, MD