# robots.txt for cached content # Policy: Allow all bots (AI crawlers and search engines) # Allow all user agents User-agent: * Allow: / # ========================================== # Resources # ========================================== # Sitemap Sitemap: /content/sitemap.xml # Original source # https://developers.googleblog.com/en/data-science-agent-in-colab-with-gemini