Models & hardware

The 9B model is the recommendation for one coherent area of the business with consistent language: one product area, one department, one set of rules. It summarises longer documents, writes emails, quotes and internal texts in your company's style, and answers questions across a larger knowledge base, including nuanced and ambiguous questions. It distinguishes stable company knowledge from day-to-day figures: it does not assert prices, stock levels or contact details; it points to the reliable source. Limits: for very large knowledge bases or particularly analytical tasks, the 27B is the right choice.

The 27B model is intended for companies that consolidate a lot of knowledge and need high answer quality. It works across very large document sets and keeps track over very long conversations and documents thanks to a native context of 262,000 tokens; it covers 201 languages. It suits tasks where an answer has to connect several threads. Limits: it is focused on your knowledge, not a universal model like the large cloud services; in return it runs entirely locally and belongs to you. Its hardware requirement is the highest.