It's always possible. A destoner will separate out items of greater mass than a typical coffee bean- so rocks stones, screws etc will be separated. Smaller items of similar mass to a been (often mud which looks like stones) can find their way into bags. The good thing is that these rarely cause problems with cafe quality grinders.
What grinder do you have? Perhaps it might be a good idea to disassemble it and give it a clean.