Databricks, a big data artificial intelligence company, has open-sourced the universal large model DBRX, which is a hybrid expert model (MoE) with 132 billion parameters.
The base (DBRX Base) and fine-tuning (DBRX Instruct) versions of DBRX have been released on GitHub and Hugging Face for research and commercial purposes. Users can run and adjust them on public, custom, or other proprietary data, or use them through APIs.
Base version: https://huggingface.co/databricks/dbrx-base
Fine-tuning version: https://huggingface.co/databricks/dbrx-instruct
GitHub link: https://github.com/databricks/dbrx
Experience address: