eric/ericxliu-me
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

📚 Auto-publish: Add/update 4 blog posts
Some checks failed
Hugo Publish CI / build-and-deploy (push) Has been cancelled
Details

Browse Source 
Generated on: Sat Aug 16 21:13:18 UTC 2025
Source: md-personal repository
This commit is contained in:
Automated Publisher
2025-08-16 21:13:18 +00:00
parent bcab4969f4
commit fc5611abc3
4 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
content/posts/a-deep-dive-into-ppo-for-language-models.md
View File

@@ -9,7 +9,7 @@ Large Language Models (LLMs) have demonstrated astonishing capabilities, but out
You may have seen diagrams like the one below, which outlines the RLHF training process. It can look intimidating, with a web of interconnected models, losses, and data flows.
![[Pasted image 20250816140700.png]]
![](/images/a-deep-dive-into-ppo-for-language-models/.png)
This post will decode that diagram, piece by piece. We'll explore the "why" behind each component, moving from high-level concepts to the deep technical reasoning that makes this process work.