diff --git a/404.html b/404.html index 8296236..4d2723b 100644 --- a/404.html +++ b/404.html @@ -4,4 +4,4 @@ 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/about/index.html b/about/index.html index e553ccd..bbc9485 100644 --- a/about/index.html +++ b/about/index.html @@ -4,4 +4,4 @@ 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/categories/index.html b/categories/index.html index fdf123f..73a9297 100644 --- a/categories/index.html +++ b/categories/index.html @@ -4,4 +4,4 @@ 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/index.html b/index.html index 4d22342..632d4a3 100644 --- a/index.html +++ b/index.html @@ -4,4 +4,4 @@ 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/index.xml b/index.xml index 7ea126a..265a19a 100644 --- a/index.xml +++ b/index.xml @@ -1,12 +1,4 @@ -Eric X. Liu's Personal Page/Recent content on Eric X. Liu's Personal PageHugoenWed, 20 Aug 2025 04:32:59 +0000A Comprehensive Guide to Breville Barista Pro Maintenance/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/Wed, 20 Aug 2025 04:32:52 +0000/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/<p>Proper maintenance is critical for the longevity and performance of a Breville Barista Pro espresso machine. Consistent cleaning not only ensures the machine functions correctly but also directly impacts the quality of the espresso produced. This guide provides a detailed, technical breakdown of the essential maintenance routines, from automated cycles to daily upkeep.</p> -<h4 id="understanding-the-two-primary-maintenance-cycles"> - <strong>Understanding the Two Primary Maintenance Cycles</strong> - <a class="heading-link" href="#understanding-the-two-primary-maintenance-cycles"> - <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> - <span class="sr-only">Link to heading</span> - </a> -</h4> -<p>The Breville Barista Pro has two distinct, automated maintenance procedures: the <strong>Cleaning (Flush) Cycle</strong> and the <strong>Descale Cycle</strong>. It is important to understand that these are not interchangeable, as they address different types of buildup within the machine.</p>A Technical Deep Dive into the Transformer's Core Mechanics/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/Wed, 20 Aug 2025 04:32:52 +0000/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/<p>The Transformer architecture is the bedrock of modern Large Language Models (LLMs). While its high-level success is widely known, a deeper understanding requires dissecting its core components. This article provides a detailed, technical breakdown of the fundamental concepts within a Transformer block, from the notion of &ldquo;channels&rdquo; to the intricate workings of the attention mechanism and its relationship with other advanced architectures like Mixture of Experts.</p> +Eric X. Liu's Personal Page/Recent content on Eric X. Liu's Personal PageHugoenWed, 20 Aug 2025 04:48:53 +0000A Technical Deep Dive into the Transformer's Core Mechanics/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/Tue, 19 Aug 2025 00:00:00 +0000/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/<p>The Transformer architecture is the bedrock of modern Large Language Models (LLMs). While its high-level success is widely known, a deeper understanding requires dissecting its core components. This article provides a detailed, technical breakdown of the fundamental concepts within a Transformer block, from the notion of &ldquo;channels&rdquo; to the intricate workings of the attention mechanism and its relationship with other advanced architectures like Mixture of Experts.</p> <h3 id="1-the-channel-a-foundational-view-of-d_model"> 1. The &ldquo;Channel&rdquo;: A Foundational View of <code>d_model</code> <a class="heading-link" href="#1-the-channel-a-foundational-view-of-d_model"> @@ -14,7 +6,15 @@ <span class="sr-only">Link to heading</span> </a> </h3> -<p>In deep learning, a &ldquo;channel&rdquo; can be thought of as a feature dimension. While this term is common in Convolutional Neural Networks for images (e.g., Red, Green, Blue channels), in LLMs, the analogous concept is the model&rsquo;s primary embedding dimension, commonly referred to as <code>d_model</code>.</p>Fixing GPU Operator Pods Stuck in Init: Secure Boot, DKMS, and MOK on Proxmox + Debian/posts/secure-boot-dkms-and-mok-on-proxmox-debian/Sat, 09 Aug 2025 00:00:00 +0000/posts/secure-boot-dkms-and-mok-on-proxmox-debian/<p>I hit an issue where all GPU Operator pods on one node were stuck in Init after migrating from Legacy BIOS to UEFI. The common error was NVIDIA components waiting for “toolkit-ready,” while the toolkit init container looped with:</p> +<p>In deep learning, a &ldquo;channel&rdquo; can be thought of as a feature dimension. While this term is common in Convolutional Neural Networks for images (e.g., Red, Green, Blue channels), in LLMs, the analogous concept is the model&rsquo;s primary embedding dimension, commonly referred to as <code>d_model</code>.</p>A Comprehensive Guide to Breville Barista Pro Maintenance/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/Sat, 16 Aug 2025 00:00:00 +0000/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/<p>Proper maintenance is critical for the longevity and performance of a Breville Barista Pro espresso machine. Consistent cleaning not only ensures the machine functions correctly but also directly impacts the quality of the espresso produced. This guide provides a detailed, technical breakdown of the essential maintenance routines, from automated cycles to daily upkeep.</p> +<h4 id="understanding-the-two-primary-maintenance-cycles"> + <strong>Understanding the Two Primary Maintenance Cycles</strong> + <a class="heading-link" href="#understanding-the-two-primary-maintenance-cycles"> + <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> + <span class="sr-only">Link to heading</span> + </a> +</h4> +<p>The Breville Barista Pro has two distinct, automated maintenance procedures: the <strong>Cleaning (Flush) Cycle</strong> and the <strong>Descale Cycle</strong>. It is important to understand that these are not interchangeable, as they address different types of buildup within the machine.</p>Fixing GPU Operator Pods Stuck in Init: Secure Boot, DKMS, and MOK on Proxmox + Debian/posts/secure-boot-dkms-and-mok-on-proxmox-debian/Sat, 09 Aug 2025 00:00:00 +0000/posts/secure-boot-dkms-and-mok-on-proxmox-debian/<p>I hit an issue where all GPU Operator pods on one node were stuck in Init after migrating from Legacy BIOS to UEFI. The common error was NVIDIA components waiting for “toolkit-ready,” while the toolkit init container looped with:</p> <ul> <li>nvidia-smi failed to communicate with the NVIDIA driver</li> <li>modprobe nvidia → “Key was rejected by service”</li> diff --git a/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/index.html b/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/index.html index 22515c1..9e4cf25 100644 --- a/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/index.html +++ b/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/index.html @@ -8,10 +8,10 @@ The Breville Barista Pro has two distinct, automated maintenance procedures: the Cleaning (Flush) Cycle and the Descale Cycle. It is important to understand that these are not interchangeable, as they address different types of buildup within the machine.">
\ No newline at end of file diff --git a/posts/a-deep-dive-into-ppo-for-language-models/index.html b/posts/a-deep-dive-into-ppo-for-language-models/index.html index c54c6d2..a30e9dc 100644 --- a/posts/a-deep-dive-into-ppo-for-language-models/index.html +++ b/posts/a-deep-dive-into-ppo-for-language-models/index.html @@ -23,4 +23,4 @@ where δ_t = r_t + γV(s_{t+1}) - V(s_t)

  • γ (gam 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/index.html b/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/index.html index 5def962..31de5ff 100644 --- a/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/index.html +++ b/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/index.html @@ -8,10 +8,10 @@ In deep learning, a “channel” can be thought of as a feature dimension. While this term is common in Convolutional Neural Networks for images (e.g., Red, Green, Blue channels), in LLMs, the analogous concept is the model’s primary embedding dimension, commonly referred to as d_model.">
    \ No newline at end of file diff --git a/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/index.html b/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/index.html index f2ce188..d77b848 100644 --- a/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/index.html +++ b/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/index.html @@ -20,4 +20,4 @@ Our overarching philosophy is simple: isolate and change only one variable at a 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/how-rvq-teaches-llms-to-see-and-hear/index.html b/posts/how-rvq-teaches-llms-to-see-and-hear/index.html index b9ede7c..6bc59f6 100644 --- a/posts/how-rvq-teaches-llms-to-see-and-hear/index.html +++ b/posts/how-rvq-teaches-llms-to-see-and-hear/index.html @@ -18,4 +18,4 @@ The answer lies in creating a universal language—a bridge between the continuo 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/index.html b/posts/index.html index a552d3e..a7951be 100644 --- a/posts/index.html +++ b/posts/index.html @@ -1,8 +1,8 @@ Posts · Eric X. Liu's Personal Page

    Posts

    Posts

    \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/index.xml b/posts/index.xml index 6812c99..4a81095 100644 --- a/posts/index.xml +++ b/posts/index.xml @@ -1,12 +1,4 @@ -Posts on Eric X. Liu's Personal Page/posts/Recent content in Posts on Eric X. Liu's Personal PageHugoenWed, 20 Aug 2025 04:32:59 +0000A Comprehensive Guide to Breville Barista Pro Maintenance/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/Wed, 20 Aug 2025 04:32:52 +0000/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/<p>Proper maintenance is critical for the longevity and performance of a Breville Barista Pro espresso machine. Consistent cleaning not only ensures the machine functions correctly but also directly impacts the quality of the espresso produced. This guide provides a detailed, technical breakdown of the essential maintenance routines, from automated cycles to daily upkeep.</p> -<h4 id="understanding-the-two-primary-maintenance-cycles"> - <strong>Understanding the Two Primary Maintenance Cycles</strong> - <a class="heading-link" href="#understanding-the-two-primary-maintenance-cycles"> - <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> - <span class="sr-only">Link to heading</span> - </a> -</h4> -<p>The Breville Barista Pro has two distinct, automated maintenance procedures: the <strong>Cleaning (Flush) Cycle</strong> and the <strong>Descale Cycle</strong>. It is important to understand that these are not interchangeable, as they address different types of buildup within the machine.</p>A Technical Deep Dive into the Transformer's Core Mechanics/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/Wed, 20 Aug 2025 04:32:52 +0000/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/<p>The Transformer architecture is the bedrock of modern Large Language Models (LLMs). While its high-level success is widely known, a deeper understanding requires dissecting its core components. This article provides a detailed, technical breakdown of the fundamental concepts within a Transformer block, from the notion of &ldquo;channels&rdquo; to the intricate workings of the attention mechanism and its relationship with other advanced architectures like Mixture of Experts.</p> +Posts on Eric X. Liu's Personal Page/posts/Recent content in Posts on Eric X. Liu's Personal PageHugoenWed, 20 Aug 2025 04:48:53 +0000A Technical Deep Dive into the Transformer's Core Mechanics/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/Tue, 19 Aug 2025 00:00:00 +0000/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/<p>The Transformer architecture is the bedrock of modern Large Language Models (LLMs). While its high-level success is widely known, a deeper understanding requires dissecting its core components. This article provides a detailed, technical breakdown of the fundamental concepts within a Transformer block, from the notion of &ldquo;channels&rdquo; to the intricate workings of the attention mechanism and its relationship with other advanced architectures like Mixture of Experts.</p> <h3 id="1-the-channel-a-foundational-view-of-d_model"> 1. The &ldquo;Channel&rdquo;: A Foundational View of <code>d_model</code> <a class="heading-link" href="#1-the-channel-a-foundational-view-of-d_model"> @@ -14,7 +6,15 @@ <span class="sr-only">Link to heading</span> </a> </h3> -<p>In deep learning, a &ldquo;channel&rdquo; can be thought of as a feature dimension. While this term is common in Convolutional Neural Networks for images (e.g., Red, Green, Blue channels), in LLMs, the analogous concept is the model&rsquo;s primary embedding dimension, commonly referred to as <code>d_model</code>.</p>Fixing GPU Operator Pods Stuck in Init: Secure Boot, DKMS, and MOK on Proxmox + Debian/posts/secure-boot-dkms-and-mok-on-proxmox-debian/Sat, 09 Aug 2025 00:00:00 +0000/posts/secure-boot-dkms-and-mok-on-proxmox-debian/<p>I hit an issue where all GPU Operator pods on one node were stuck in Init after migrating from Legacy BIOS to UEFI. The common error was NVIDIA components waiting for “toolkit-ready,” while the toolkit init container looped with:</p> +<p>In deep learning, a &ldquo;channel&rdquo; can be thought of as a feature dimension. While this term is common in Convolutional Neural Networks for images (e.g., Red, Green, Blue channels), in LLMs, the analogous concept is the model&rsquo;s primary embedding dimension, commonly referred to as <code>d_model</code>.</p>A Comprehensive Guide to Breville Barista Pro Maintenance/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/Sat, 16 Aug 2025 00:00:00 +0000/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/<p>Proper maintenance is critical for the longevity and performance of a Breville Barista Pro espresso machine. Consistent cleaning not only ensures the machine functions correctly but also directly impacts the quality of the espresso produced. This guide provides a detailed, technical breakdown of the essential maintenance routines, from automated cycles to daily upkeep.</p> +<h4 id="understanding-the-two-primary-maintenance-cycles"> + <strong>Understanding the Two Primary Maintenance Cycles</strong> + <a class="heading-link" href="#understanding-the-two-primary-maintenance-cycles"> + <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> + <span class="sr-only">Link to heading</span> + </a> +</h4> +<p>The Breville Barista Pro has two distinct, automated maintenance procedures: the <strong>Cleaning (Flush) Cycle</strong> and the <strong>Descale Cycle</strong>. It is important to understand that these are not interchangeable, as they address different types of buildup within the machine.</p>Fixing GPU Operator Pods Stuck in Init: Secure Boot, DKMS, and MOK on Proxmox + Debian/posts/secure-boot-dkms-and-mok-on-proxmox-debian/Sat, 09 Aug 2025 00:00:00 +0000/posts/secure-boot-dkms-and-mok-on-proxmox-debian/<p>I hit an issue where all GPU Operator pods on one node were stuck in Init after migrating from Legacy BIOS to UEFI. The common error was NVIDIA components waiting for “toolkit-ready,” while the toolkit init container looped with:</p> <ul> <li>nvidia-smi failed to communicate with the NVIDIA driver</li> <li>modprobe nvidia → “Key was rejected by service”</li> diff --git a/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/index.html b/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/index.html index 8f70bdb..34c8bb3 100644 --- a/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/index.html +++ b/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/index.html @@ -44,4 +44,4 @@ The Top-K routing mechanism, as illustrated in the provided ima 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/secure-boot-dkms-and-mok-on-proxmox-debian/index.html b/posts/secure-boot-dkms-and-mok-on-proxmox-debian/index.html index 56a0ae6..c775455 100644 --- a/posts/secure-boot-dkms-and-mok-on-proxmox-debian/index.html +++ b/posts/secure-boot-dkms-and-mok-on-proxmox-debian/index.html @@ -59,4 +59,4 @@ nvidia-smi failed to communicate with the NVIDIA driver modprobe nvidia → “K 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/supabase-deep-dive/index.html b/posts/supabase-deep-dive/index.html index d4b271c..8b0b3f9 100644 --- a/posts/supabase-deep-dive/index.html +++ b/posts/supabase-deep-dive/index.html @@ -90,4 +90,4 @@ Supabase enters this space with a radically different philosophy: transparency. 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/index.html b/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/index.html index 6bba40d..389c5a2 100644 --- a/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/index.html +++ b/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/index.html @@ -30,4 +30,4 @@ But to truly understand the field, we must look at the pivotal models that explo 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/posts/useful/index.html b/posts/useful/index.html index de320ed..b13824b 100644 --- a/posts/useful/index.html +++ b/posts/useful/index.html @@ -9,4 +9,4 @@ One-minute read
    • [0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file diff --git a/sitemap.xml b/sitemap.xml index f5929cb..34072e7 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -1 +1 @@ -/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/2025-08-20T04:32:59+00:00weekly0.5/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/2025-08-20T04:32:59+00:00weekly0.5/2025-08-20T04:32:59+00:00weekly0.5/posts/2025-08-20T04:32:59+00:00weekly0.5/posts/secure-boot-dkms-and-mok-on-proxmox-debian/2025-08-14T06:50:22+00:00weekly0.5/posts/how-rvq-teaches-llms-to-see-and-hear/2025-08-08T17:36:52+00:00weekly0.5/posts/supabase-deep-dive/2025-08-04T03:59:37+00:00weekly0.5/posts/a-deep-dive-into-ppo-for-language-models/2025-08-16T21:13:18+00:00weekly0.5/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/2025-08-03T06:02:48+00:00weekly0.5/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/2025-08-03T03:41:10+00:00weekly0.5/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/2025-08-03T04:20:20+00:00weekly0.5/posts/useful/2025-08-03T08:37:28-07:00weekly0.5/about/2020-06-16T23:30:17-07:00weekly0.5/categories/weekly0.5/tags/weekly0.5 \ No newline at end of file +/posts/a-technical-deep-dive-into-the-transformer-s-core-mechanics/2025-08-20T04:48:53+00:00weekly0.5/2025-08-20T04:48:53+00:00weekly0.5/posts/2025-08-20T04:48:53+00:00weekly0.5/posts/a-comprehensive-guide-to-breville-barista-pro-maintenance/2025-08-20T04:48:53+00:00weekly0.5/posts/secure-boot-dkms-and-mok-on-proxmox-debian/2025-08-14T06:50:22+00:00weekly0.5/posts/how-rvq-teaches-llms-to-see-and-hear/2025-08-08T17:36:52+00:00weekly0.5/posts/supabase-deep-dive/2025-08-04T03:59:37+00:00weekly0.5/posts/a-deep-dive-into-ppo-for-language-models/2025-08-16T21:13:18+00:00weekly0.5/posts/mixture-of-experts-moe-models-challenges-solutions-in-practice/2025-08-03T06:02:48+00:00weekly0.5/posts/t5-the-transformer-that-zigged-when-others-zagged-an-architectural-deep-dive/2025-08-03T03:41:10+00:00weekly0.5/posts/espresso-theory-application-a-guide-for-the-breville-barista-pro/2025-08-03T04:20:20+00:00weekly0.5/posts/useful/2025-08-03T08:37:28-07:00weekly0.5/about/2020-06-16T23:30:17-07:00weekly0.5/categories/weekly0.5/tags/weekly0.5 \ No newline at end of file diff --git a/tags/index.html b/tags/index.html index a692fb4..0ede996 100644 --- a/tags/index.html +++ b/tags/index.html @@ -4,4 +4,4 @@ 2016 - 2025 Eric X. Liu -[0945204] \ No newline at end of file +[ed94cec] \ No newline at end of file