Complete hardware + software setup for running Deepseek-R1 locally. The actual model, no distillations, and Q8 quantization for full quality. Total cost, $6,000. All download and part links below:
— Matthew Carrigan (@carrigmat) January 28, 2025
Notes 202505

You might also like

Notes 202506
you DO NOT want to miss the article about using an llm as your health assistant, this is GOLD 🏅

Notes 202645
Context compression for month-long agent sessions and a 284B model running on a 64GB CPU, a fan revival of Underground 2, the personal knowledge graph macOS builds about you, a TUI Slack client in Go, and Expo's write-once native apps.

Notes 202644
A social network for developers, the end of UTC leap seconds, two open-source local voice dictation apps, agent skills for generating images, video and 3D, and a Rust native UI framework.

Notes 202643
ship less javascript, app architecture, android on mac and other useful links

Notes 202642
an open taxonomy of what children learn, migrating from nvm to mise, and a real-time speech-to-speech model with persona control

Notes 202641
a personal AI agent in your own Cloudflare account, a suite of open-source creative apps, an ultra-legible typeface, sideloading your own apps onto an iPhone, git worktrees and the Apple Siri Remote on Linux