Something to consider, conventional cherries are sprayed with chemicals 3 times a week to help prevent the pesky cherry fruit fly from destroying the crop. The fruit you eat has been sprayed 3 times a week from the time it appeared as a bud. A simple rinse under the sink isn't going to get rid of those chemicals that have been layered on. Just something to consider. And to all you conventional cherry farmers, something for you to consider might be getting some chickens who will eat the fruit fly larva.
Grapes are another big one. Sigh, it's a constant battle inside me, my love of wine and hatred of pesticides.
For further reading, start with this list of produce to buy organic.