Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
OctoThinker (OctoThinker)
[go: Go Back, main page]
Hugging Face's logo
Activity Feed

AI & ML interests

None defined yet.

Organization Card
Community About org cards

šŸ™ OctoThinker is led by GAIR

šŸŽÆ Our Goal: To reshape the pre-training trajectory so models scale better under RL.

Check our technical report for more details!

image/png

Collections 4

Mid-training Analysis Checkpoints (Llama-3.2-3B)
What makes a base language model suitable for RL? Through controlled experiments, we identify key factors then leverage them to scale up mid-training.
OctoThinker-Llama-8B Family
What makes a base language model suitable for RL? Through controlled experiments, we identify key factors then leverage them to scale up mid-training.
Mid-training Analysis Checkpoints (Llama-3.2-3B)
What makes a base language model suitable for RL? Through controlled experiments, we identify key factors then leverage them to scale up mid-training.
OctoThinker-Llama-8B Family
What makes a base language model suitable for RL? Through controlled experiments, we identify key factors then leverage them to scale up mid-training.
View 4 collections