Falcon

Falcon is a family of open language models from the Technology Innovation Institute (UAE), available in 7B, 40B, and 180B parameter variants. The flagship Falcon 180B is one of the largest open LLMs, trained on ~3.5 trillion tokens from the RefinedWeb corpus and other high-quality data, allowing it to compete in quality of text, code, and reasoning with closed models at the level of GPT-3.5 and PaLM. A typical context length is around 2K tokens, which is sufficient for complex dialogues and working with medium-sized documents. Technically, Falcon is a decoder-only Transformer with an optimized attention architecture and a large pre-trained base, available under an open license for commercial use. Based on Falcon, you can develop enterprise chatbots, support assistants, developer tools, text generation and analysis systems, as well as RAG solutions on top of internal knowledge bases. The FreeBlock team will select the right Falcon version, fine-tune it on your data, and integrate it into your products and infrastructure. If you need powerful open LLMs without vendor lock-in, order AI project development based on Falcon from FreeBlock.