Tag
PyTorch
PyTorch is a Python-first deep learning framework used for training, inference, and rapid prototyping. It often sits alongside CUDA, vLLM, and RAG tooling in modern AI stacks, making it central to how models move from research code to deployment.
5 articles
Open-source AI software is winning on infrastructure, not hype
Open-source AI software is winning because it now powers the core infrastructure for building, serving, and shipping models.
ROCm vs CUDA: GPU Computing Comparison
ROCm and CUDA trade lower cost and openness against broader support and faster performance.
PEFT for LLM Fine-Tuning Without Full Retraining
PEFT lets developers fine-tune LLMs by training small adapter layers instead of all weights.
TurboQuant shows how 4-bit beats guesswork
I break down TurboQuant’s quantization study into a practical playbook for choosing 8-bit, 4-bit, PTQ, or QAT.
Awesome Open Source AI: the best projects list
This GitHub list curates battle-tested open-source AI tools, models, and infra, from PyTorch to vLLM, with 2,486 stars.