seoRobotsTxt function

String seoRobotsTxt({
  1. required String siteBase,
  2. bool includeSitemap = true,
})

Generates a robots.txt that allows all crawlers and announces the sitemap.

Implementation

String seoRobotsTxt({required String siteBase, bool includeSitemap = true}) {
  final base = siteBase.endsWith('/')
      ? siteBase.substring(0, siteBase.length - 1)
      : siteBase;
  final buffer = StringBuffer()
    ..writeln('User-agent: *')
    ..writeln('Allow: /');
  if (includeSitemap) {
    buffer
      ..writeln()
      ..writeln('Sitemap: $base/sitemap.xml');
  }
  return buffer.toString();
}