“raid” implies non-consent, so no, that’s not fair.
It’s also not fair for a farmer to find some prime farmland, build a fence around it and say no one else can touch it, and then keep everything it produces to himself, and then call everyone who wasn’t able to claim good land but still wants to eat a thief.
Why does he get rights to the land just because he said it’s his? That leads to feudalism.
“Civilization” is about finding balance to what’s fair.
It’s unfair for people to want something for nothing.
That extends to people wanting food, and also to the farmer claiming land.
Some arrangement where the farmer gets to keep his crops, but can’t exclude people from also working the land, with some sort of communal oversight to make sure the land is being worked well seems fair.