Subword Tokenization Algorithms
Understanding the algorithms behind tokenization in Large Language Models.
Technical
RSS feedPosts in 2025
- $What is LLM Inference?What is LLM Inference?Understanding how Large Language Models generate text through the inference process.
- $CUDA Programming: An IntroductionCUDA Programming: An IntroductionGetting started with CUDA programming: Hello Threads
- $A Tale of Software RotA Tale of Software RotA fictional story about systematically eliminating duplication to prevent software rot in a growing engineering organization.
- $OAuth 2.0 Flows, Security and Best PracticesOAuth 2.0 Flows, Security and Best PracticesComprehensive OAuth 2.0 reference covering authorization flows, PKCE, token security, SPA patterns, and implementation best practices with detailed diagrams.
- $Decision Tree: DyanamoDB vs Aurora PostgreSQLDecision Tree: DyanamoDB vs Aurora PostgreSQLWhich one should you pick
- $Embedding Selection for RAG SystemsEmbedding Selection for RAG SystemsAt the heart of every effective RAG implementation lies a crucial decision: which embedding model to use.
- $Diffusion Based Language ModelsDiffusion Based Language ModelsInstead of writing sequentially, DLMs start with something like noisy or scrambled text and gradually denoise it over several steps.
