It could search for all kinds of keywords to enforce rules. For example, scan titles to find question identifiers to suggest a user maybe needed to check an FAQ/wiki, or that kind of thing. Find keywords to detect probable off-topics. That sort of stuff.
At the end of the day, is what the LLM bot doing really any different? I'd say it's more sophisticated but the same fundamental thing.