I suppose you could (I’m assuming they are the expanded clay type) and it would likely increase aeration.
If your goal is to save a bit of money, it won’t. Those rocks are not cheap.
Perlite does the same thing and is cheap when bought in bulk. I got 4 cubic feet for $35. Just don’t buy the small bags. Those add up fast.