Large Language Models are everywhere and are getting better at understanding the web almost in real time.

However, because of the size of their context windows, they might miss key information about websites amidst ads, scripts, banners, or other irrelevant content that isn’t about the actual information itself.

That’s where the llms.txt file plays a role: it allows us to have a compressed version of our site or pages of our site in a format that LLMs easily understand: Markdown.

In this article, we will learn how to add a llms.txt file to a Rails application and some best practices.

https://avohq.io/blog/llms-txt-rails