Stone can be harvested from many sources. Buildings, rubble piles and unsurprisingly stones are good for harvesting. You can also get stacks of stone from chests, supply drops, llamas and find them laying around the map.

Stone is the second strongest crafting material so it's a good idea to have enough to see you through any build battle.