Optimization

4 items

Local LLM Inference — Caching , Machine-Learning , Optimization and +1 more
An empirical systems exploration of local LLM inference on unified memory architectures: profiling compute-bound prefill vs. memory-bound decode phases, analyzing KV cache retention during cancellation, measuring the 64K vs. 128K context cliff on Apple Silicon, and comparing client payload strategies.
Algorithms & Performance — Algorithms , Latency , Optimization and +2 more
Principles for clear algorithms and effective performance engineering; utilizing strict micro-benchmarking, careful memory allocation discipline, avoiding cache misses, and deterministic random generators.
Rustoku — Optimization , Search-Algorithms , Systems-Programming
A highly optimized Sudoku engine engineered in Rust, featuring advanced human-like techniques, multi-platform support (Python, WASM), and microsecond-level performance.
VirtuC — Algorithms , Compilers , Optimization and +2 more
A from-scratch, Rust-implemented compiler designed for a targeted C subset that effectively emits standard LLVM IR; heavily focusing on proper AST design, semantic checking, and IR verification.