Sorry to pop in late here, but let me do a little addition to the Ginkgo biloba...
I am a grad student studying under a Plant taxonomist, who is my advisor. I asked her about Ginkgo before, because I was a little confused myself. According to her, the Ginkgo produces a "Fleshy cone". Yes it looks like a fruit, but technically it is a cone. It is a gymnosperm.
Taxus baccata, aka yew, has an aril, which is a fleshy seed. It is not a berry.