## 02 – Transformers

<div align="center">
  <table>
    <tr>
      <td align="center"><img src="https://cdn-icons-png.flaticon.com/512/1990/1990520.png" width="80"/></td>
      <td align="center"><img src="https://cdn-icons-png.flaticon.com/512/5567/5567602.png" width="80"/></td>
      <td align="center"><img src="https://cdn-icons-png.flaticon.com/512/6231/6231228.png" width="80"/></td>
    </tr>
  </table>
</div>

In these projects, it is possible to build a Transformer model **from scratch** to better understand its internal components and training process.

| Project | Description | Resource |
| :--- | :--- | :--- |
| **Mini GPT Char Transformer** | Demonstrates how a Transformer model is built from scratch at the character level. | Based on this video: https://www.youtube.com/watch?v=VMj-3S1tku0 |
| **Genesis Transformer** | Shows how to build and train a character-level Transformer using the *Book of Genesis* from the Bible as the training dataset. | Based on this video: https://www.youtube.com/watch?v=VMj-3S1tku0 |
