← Back to context Comment by jeremyjh 3 hours ago The crawlers are not AI. The crawlers are deterministic. They are collecting data to train AIs. 1 comment jeremyjh Reply jonhohle 3 hours ago But gitweb is probably the second most used method of hosting a git repo and easily recognizable through heuristics. If it’s gitweb, fallback to git access and save everyone, including the crawler, time and resources.
jonhohle 3 hours ago But gitweb is probably the second most used method of hosting a git repo and easily recognizable through heuristics. If it’s gitweb, fallback to git access and save everyone, including the crawler, time and resources.
But gitweb is probably the second most used method of hosting a git repo and easily recognizable through heuristics. If it’s gitweb, fallback to git access and save everyone, including the crawler, time and resources.