Oxen.ai Blog

Welcome to the Oxen.ai blog 🐂

The team at Oxen.ai is dedicated to helping AI practictioners go from research to production. To help enable this, we host a research paper club on Fridays called ArXiv Dives, where we go over state of the art research and how you can apply it to your own work.

Take a look at our Arxiv Dives, Practical ML Dives as well as a treasure trove of content on how to go from raw datasets to production ready AI/ML systems. We cover everything from prompt engineering, fine-tuning, computer vision, natural language understanding, generative ai, data engineering, to best practices when versioning your data. So, dive in and explore – we're excited to share our journey and learnings with you 🚀

How RWKV-7 Goose Works 🪿 + Notes from the Author
How RWKV-7 Goose Works 🪿 + Notes from the Author

In this special Arxiv Dive, we're joined by Eugene Cheah - author, lead in RWKV org, CEO of Featherless AI, to discuss the development process and key decisions behind these models...

Greg Schoeninger
Greg Schoeninger
4/15/2025
- Arxiv Dives
17 min read
How Phi-4 Cracked Small Multimodality
How Phi-4 Cracked Small Multimodality

Phi-4 extends the existing Phi model’s capabilities by adding vision and audio all in the same model. This means you can do everything from understand images, generate code, recogn...

Greg Schoeninger
Greg Schoeninger
3/26/2025
- Arxiv Dives
8 min read
Why GRPO is Important and How it Works
Why GRPO is Important and How it Works

Last week on Arxiv Dives we dug into research behind DeepSeek-R1, and uncovered that one of the techniques they use in the their training pipeline is called Group Relative Policy O...

Greg Schoeninger
Greg Schoeninger
2/12/2025
- Arxiv Dives
12 min read
How DeepSeek R1, GRPO, and Previous DeepSeek Models Work
How DeepSeek R1, GRPO, and Previous DeepSeek Models Work

In January 2025, DeepSeek took a shot directly at OpenAI by releasing a suite of models that “Rival OpenAI’s o1.” From their website: In the spirit of Arxiv Dives we are going to...

Greg Schoeninger
Greg Schoeninger
2/4/2025
- Arxiv Dives
15 min read
No Hype DeepSeek-R1 Reading List
No Hype DeepSeek-R1 Reading List

DeepSeek-R1 is a big step forward in the open model ecosystem for AI with their latest model competing with OpenAI's o1 on a variety of metrics. There is a lot of hype, and a lot o...

Greg Schoeninger
Greg Schoeninger
1/30/2025
- Arxiv Dives
27 min read
arXiv Dive: RAGAS - Retrieval Augmented Generation Assessment
arXiv Dive: RAGAS - Retrieval Augmented Generation Assessment

RAGAS is an evaluation framework for Retrieval Augmented Generation (RAG). A paper released by Exploding Gradients, AMPLYFI, and CardiffNLP. RAGAS gives us a suite of metrics that ...

Greg Schoeninger
Greg Schoeninger
1/21/2025
- Arxiv Dives
13 min read
OpenCoder: The OPEN Cookbook For Top-Tier Code LLMs
OpenCoder: The OPEN Cookbook For Top-Tier Code LLMs

Welcome to the last arXiv Dive of 2024! Every other week we have been diving into interesting research papers in AI/ML. In this blog we’ll be diving into Open Coder, a paper and co...

Greg Schoeninger
Greg Schoeninger
12/24/2024
- Arxiv Dives
14 min read
LLaVA-CoT: Let Vision Language Models Reason Step-By-Step
LLaVA-CoT: Let Vision Language Models Reason Step-By-Step

When it comes to large language models, it is still the early innings. Many of them still hallucinate, fail to follow instructions, or generally don’t work. The only way to combat ...

Greg Schoeninger
Greg Schoeninger
12/10/2024
- Arxiv Dives
12 min read
How Upcycling MoEs Beat Dense LLMs
How Upcycling MoEs Beat Dense LLMs

In this Arxiv Dive, Nvidia researcher, Ethan He, presents his co-authored work Upcycling LLMs in Mixture of Experts (MoE). He goes into what a MoE is, the challenges behind upcycli...

Greg Schoeninger
Greg Schoeninger
11/19/2024
- Arxiv Dives
1 min read
Thinking LLMs: General Instruction Following with Thought Generation
Thinking LLMs: General Instruction Following with Thought Generation

The release of OpenAI-O1 has motivated a lot of people to think deeply about…thoughts 💭. Thinking before you speak is a skill that some people have better than others 😉, but a sk...

Greg Schoeninger
Greg Schoeninger
11/11/2024
- Arxiv Dives
14 min read