Astro Gallery of Gems – Midtown East
417 Fifth Avenue between 37th and 38th Streets
Unfortunately FAO Schwarz closed in July 2015.
For a truly hands-on experience, check out Astro Gallery of Gems, which has two Manhattan locations. Inside its new 10,000-square-foot showroom in Midtown East, visitors of all ages can touch everything from polished, tumbled stones to a 2,000-pound amethyst geode. However, its Astro Kids outpost in FAO Schwarz is even more family-friendly. At this interactive shop, young kids can pick up and examine authentic fossils, bones, stalagmites and meteorites, which are much heavier than they look. But the highlight is picking out a rock and watching it get cracked open to reveal the sparkling geode inside (for a fee of course). Up for a splurge? Geodes and stones can be transformed into custom jewelry, and you can also buy at-home geode kits, fossil shark and dinosaur teeth necklaces, and mounted insects.

Rock Star Crystals – Chelsea
150 West 28th Street between Sixth and Seventh Avenues, suite 201B
This warehouse is open to the public and sells minerals, rocks, gemstone jewelry, fossils, meteorites, shells, and even metaphysical tools that harness the purported healing powers of these natural wonders. Be advised that you'll be watched by cameras the entire time you're there, which can be a bit discomforting, and there's a $15 credit card minimum.

American Geode – Midtown West
449 West 48th Street near Tenth Avenue
Open only on weekends, this rockhounding spot sells gems, fossils and "diamonds" (really quartz crystals) dug up by the owners right here in the New York area. Want to unearth your own treasures? They invite budding mineralogists to join them on their many adventures.

American Museum of Natural History – Upper West Side
Central Park West at 79th Street
Although it's obvious, we couldn't do a post about natural artifacts without mentioning NYC's biggest collection of them all. At the Harry Frank Guggenheim Hall of Minerals, families can learn all about the physical, chemical and optical properties of the minerals on view, and the various environments that created them. If you're hankering to see giant meteors, they're on view in the Arthur Ross Hall of Meteorites, which includes a display about what happens when they crash down to Earth. Finally, those famous giant bones are on view in the David H. Koch Dinosaur Wing.

Bonus: NY/NJ Mineral, Fossil, Gem & Jewelry Show – Edison, New Jersey
NJ Convention & Expo Center, 97 Sunfield Avenue
If your kids are really into natural artifacts, consider hitting this annual spring convention in nearby New Jersey. Join 14,000 fellow enthusiasts to peruse 400 booths hawking gems and minerals from all over the world, below the oceans, and even outer space! Admission is $10 for adults, $5 for children ages 5 to 12, but you'll probably end up shelling out a lot more than that before you leave.

More of a DIY family? Check out this comprehensive list of local sites where you can try digging up your own gems and fossils.