chrisneedham , 
"Some suggestions for robots.txt" is the BBC's position paper for the Internet Architecture Board AI-Control Workshop in September, written by myself and my colleague Piers: https://datatracker.ietf.org/doc/slides-aicontrolws-some-suggestions-to-improve-robotstxt/. More about the workshop itself: https://datatracker.ietf.org/group/aicontrolws/
