XGen

Description of XGen

XGen is an open 7B language model from Salesforce, originally designed for working with long sequences. The XGen-7B line was trained on up to 1.5 trillion tokens with context lengths of up to 8K, making it especially strong in tasks involving large documents, long dialogue history, and complex prompts. Variants include XGen-7B-4K and XGen-7B-8K, as well as instruction-tuned XGen-7B-8K-Inst models under the Apache 2.0 license, which is convenient for commercial use. Architecturally, XGen is a dense decoder-only Transformer optimized for efficient training and inference on long contexts with a moderate parameter count (7B). XGen can be used to build assistants for working with documentation, legal and financial RAG systems, analytical helpers, chatbots with “long memory,” as well as embedded AI modules for CRM and internal portals. FreeBlock handles XGen fine-tuning on company data, search+generation pipeline setup, and deployment in your infrastructure. If you want to unlock value from long documents and dialogues, order AI project development based on XGen from FreeBlock

All Technologies