Prerender docs on the server side

[mxschmitt]

Feature Request

Improve the SEO for Google etc. by adding a sitemap and a robots.txt

Problem description

When we search e.g. for "semantic ui react label", no result for the react label will appear:

Proposed solution

• add a sitemap.xml
• add a robots.txt which refer to the sitemap

MVP

Best way would be to not hard code the sitemap. So maybe we could generate the links?

I'm also not sure, if this repo is the correct place for such an issue. I haven't found the repository for the semantic ui react documentation page yet.

Edit:

I tried to find the URLs in Google by searching for site:https://react.semantic-ui.com/elements/label.
=> Google has indexed the result, so maybe just the SEO is very bad on these pages? idk

[welcome]

👋 Thanks for opening your first issue here! If you're reporting a 🐞 bug, please make sure you've completed all the fields in the issue template so we can best help.

We get a lot of issues on this repo, so please be patient and we will get back to you as soon as we can.

[layershifter]

I want to try move our docs to Gatsby, it looks like the best solution there.

[levithomason]

Prerendering would be great.