I’d say raspberries and blackberries just because I’ve found them in the wild in heavily wooded areas. If you’ve ever been to upper Washington state, they grow like weeds there. Rhubarb is another I know. Google clams cherry’s and Alpine strawberries as far as other fruits.
I googled vegetables and it basically said most root or leaf ones. Like spinach or leaf lettuce. Asparagus would be a good candidate. It loves sandy soil if you have an area of that. A patch will produce for 20-50 years once established.
as you stated I’m sure a lot of things will grow, just not produce a lot. I would think it would be worth looking into and at least attempting the things you’re most interested in.
As far as perennial, I have a cherry tree, raspberries, blackberries, grapes and asparagus going. I would love to find a spot for another fruit tree or two, but I’m in about the same boat as you at this point.