Generate the robots.txt file for a Astro app

Just copy and paste a file that will generate the robots.txt file for the site, allowing all search engines to index every route and specifying the location of the sitemap.

Usage

Add the file to your project

Copy the robots.txt.ts file to your project's pages folder.