RetroFed Forums
Your home away from modern life.
Search Categories Forum list Register Log in
About RetroFed
RetroFed

Welcome to the nostalgia-filled piefed instance of yesteryear.

Open Registration with Application questionnaire.

If you have a question or comment you can post in !meta@retrofed.com or message @DosDude@retrofed.com or @Die4Ever@retrofed.com

In case of downtime and/or emergency, we will post updates on @DosDude@mastodon.social

Some rules we try to uphold:

  • Be civil. Bigotry is not welcome. This includes (but is not limited to): transphobia, queerphobia, racism, ageism and ableism. We do not promote hate.
  • Communities need to be Retro or Retro-adjacent.
  • Please don't upload pornographic content. (use an external image host for that)
72 registered users
Administrators: DosDude, Die4Ever
Visit retrofed.com
Qwen1.5-MoE-A2.7B: A Small MoE Model with only 2.7B Activated Parameters yet Matching the Performance of State-of-the-Art 7B models
Post Reply RetroFed Forums Forum Index » Machine Learning
AuthorMessage
Akisamb
programming.dev
Akisamb@programming.dev
Joined: 2023-06-14
Posted:   Subject: Qwen1.5-MoE-A2.7B: A Small MoE Model with only 2.7B Activated Parameters yet Matching the Performance of State-of-the-Art 7B models Quote

Link: https://www.marktechpost.com/2024/03/29/alibaba-releases-qwen1-5-moe-a2-7b-a-small-moe-model-with-only-2-7b-activated-parameters-yet-matching-the-performance-of-state-of-the-art-7b-models-like-mistral-7b/
1   Original
Post Reply Page 1
Powered by RetroFed · PieBB frontend · All times are Europe/Amsterdam