Training LFM-2.5-350M on Reddit post summarization with GRPO on my 3x Mac Minis — final evals and t-test evals are here

So, with this project I want to see if a length constrained (like 64 tokens only) quality summarization can be done by tiny LLMs using GRPO! So, I trained two variants of this task: using just length penalty using a single quality reward/combination of those and length penalty I ran LLM-As-A-Judge eval for checking the summarization quality using DeepEval tools. Those are: Consciencess Coverage Clarity Faitfullness Th results are as attached and the final one is follows: with quality (ROUGE-L +

More from Reddit

Stanford researchers fed a language model a DNA sequence and asked it to create a new virus. It wrote hundreds of them, and 16 worked. One used a protein that doesn't exist in any known organism on Earth.

Reddit

You're right to push back.

Reddit

No way to export ChatGPT Workspace chats?

Reddit

Image 2 Is Really COOL 😻

Reddit

Payment error. Your card may be invalid or authentication may be needed.

Reddit

This is where we are right now, LocalLLaMA

Reddit