After pulling out large plants I find moving the clay around a bit with your hands and the gravel sinks.