Update

index.html

@@ -512,11 +512,11 @@
 <ul>
 <li>No distributed techniques at play</li>
 </ul></li>
-<li>DDP:
+<li>Distributed Data Parallelism (DDP):
 <ul>
 <li>A full copy of the model exists on each device, but data is chunked between each GPU</li>
 </ul></li>
-<li>FSDP &amp; DeepSpeed:
+<li>Fully Sharded Data Parallelism (FSDP) &amp; DeepSpeed (DS):
 <ul>
 <li>Split chunks of the model and optimizer states across GPUs, allowing for training bigger models on smaller (multiple) GPUs</li>
 </ul></li>

llm_conf.qmd

@@ -61,9 +61,9 @@ What can we do?
 
 * Single GPU:
   * No distributed techniques at play
-* DDP: 
+* Distributed Data Parallelism (DDP): 
   * A full copy of the model exists on each device, but data is chunked between each GPU
-* FSDP & DeepSpeed:
+* Fully Sharded Data Parallelism (FSDP) & DeepSpeed (DS):
   * Split chunks of the model and optimizer states across GPUs, allowing for training bigger models on smaller (multiple) GPUs