My favorite souvenirs are the shells I find while snorkeling or scuba diving. I'm always careful to make sure they are empty before removing them from the water. My second favorite are the coconuts I have out by our pool. Each one is marked to show the island and year of our trip.
My wife gets a magnet for the fridge from each of the islands we've been to.