Yes, we would be. But then it happens again and again and again and before you know it there's hundreds of thousands of acres of farmland dedicated to solar panels. Not to mention new housing developments that are literally everywhere. Farmland is being eroded constantly.
Farmland and agriculture is being eroded and legislated against growing food, but no one ever mentions the amount of carbon storage in farmland.
"Going after farming" - how exactly? What way would you suggest going after people that rear livestock and grow food?
This video explains things better than I could, it was made in relation to the farming documentary on BBC a couple of years ago.
https://www.youtube.com/watch?v=M3X-_Bqs_0k
It won't take a huge amount to create a food emergency, we are already net importers of food. Take away more food production and we are then importing MORE food. Where does it go from there?