TGArchive
·2 хв читання · 315 слів·👁 10.8K18

Mistral AI — Revolution in Open-Source AI

🆕 The highlight of the week: Mistral AI released a new public model — Mixtral-8x7B, which has reached the level of GPT-3.5 according to tests. We tell you how the most popular AI startup in Europe is evolving.

💲 Grew 7 times in 7 months. The startup was founded in Paris by ex-managers from Meta and Google in May 2023. The first round of investment (even before the product was released) was $113 million. In September, Mistral AI introduced its debut model, the Mistral 7B, marking its foray into open-source generative AI. By December, the startup secured a second funding round of $415 million, led by the well-known venture capitalists Andreessen Horowitz and Lightspeed. Recent valuations estimate the startup's worth at a staggering $2 billion.

⚡️ Mixtral-8x7B: a competitor to GPT-3.5, available via torrent link. Mistral AI not only left the code of its new model open but also released it without public events in a simple post on X, uploading 87 GB simply on a torrent. The community reacted positively: "Mistral is what OpenAI should have been."

Features of Mixtral-8x7B:

→ Developed on the same architectural principles as GPT-4.
→ Handles a context of 32,000 tokens (in the GPT-3.5 family, the maximum is 16,000 tokens)
→ Shows strong performance in code generation.
→ Officially supports five languages: English, French, Italian, German, and Spanish.

About Mixtral-8x7B:

→ Compared to another open model, Llama 2, Mixtral is more credible (73.9% against 50.2% in the TruthfulQA test).
→ On MT-Bench, it scores 8.30, making it the best open-source model with performance comparable to GPT-3.5.
→ Based on the cooperation between 8 AI agents, the model selects the best solution and produces more creative content.

✈️ You can test the model here, just choose Mistral 8x7b to chat with the bot.

What do you think of the new model?

#Mistral @hiaimediaen

Відкрити в Telegram
Повернутись до каналу