Ben Bodenmiller 595a93ee2c disallow irrelevant pages by default in robots ...

Update default robots.txt rules to disallow irrelevant pages that search
engines should not care about. This will still allow important pages
like the files, commit details, merge requests, issues, comments, etc.
to be crawled.

2015-08-17 23:11:16 -07:00

..

uploads

Make sure important directories exist in git

2014-03-30 22:45:28 -04:00

404.html

Improve text on error pages.

2015-05-13 09:41:55 +02:00

422.html

Fix 422 error page.

2015-05-13 09:41:56 +02:00

500.html

Improve text on error pages.

2015-05-13 09:41:55 +02:00

502.html

Improve text on error pages.

2015-05-13 09:41:55 +02:00

apple-touch-icon-precomposed.png

Replace old logo with new one

2015-06-19 16:59:16 +02:00

apple-touch-icon.png

Replace old logo with new one

2015-06-19 16:59:16 +02:00

deploy.html

Replace old logo with new one

2015-06-19 16:59:16 +02:00

favicon.ico

Replace old logo with new one

2015-06-19 16:59:16 +02:00

logo.svg

Replace old logo with new one

2015-06-19 16:59:16 +02:00

robots.txt

disallow irrelevant pages by default in robots

2015-08-17 23:11:16 -07:00

static.css

Improve text on error pages.

2015-05-13 09:41:55 +02:00