# Allow everything. Pages that must not be indexed say so with a # noindex meta tag, which only works if the crawler may fetch them. User-agent: * Allow: / Sitemap: https://repogates.com/sitemap.xml