Self-Hosting Open-Source LLMs: Getting Started with Ollama, vLLM, and llama.cpp
Technical trends, engineering practices, and an independent developer's perspective on LLMs and open source.
This aggregates CodeNodeX AI community articles and discussions related to 开源, covering concept explanations, tool comparisons, engineering practices, common issues, and indie hacking experience.
If you're researching 开源, start with high-quality long-form articles, then join post discussions for a complete understanding-to-practice path.
Technical trends, engineering practices, and an independent developer's perspective on LLMs and open source.
Technical trends, engineering practices, and an independent developer's perspective on independent development and open source.
Centered on the technical trends, engineering practices, and indie developer perspectives of indie development and open source.
"Local mode" and "enterprise no-training" are not enough to prove code stays within bounds. This article binds repository classification, task materials, execution location, model calls, and residue cleanup into a verifiable routing contract, and defines safe degradation when cloud capability is unavailable.
Being able to export chat JSON doesn't mean you can leave a coding tool. This article defines a content-addressed exit package covering repository rules, task checkpoints, approvals, tool configuration, and audit receipts, and uses a cold start with an alternative tool to prove migration and revocation are truly complete.
Example-based tests easily share blind spots with the model implementation. This article extracts invariants from requirements, designs generators, shrinkers, and deterministic seeds, and uses counterexample regression gates to validate the input space of AI-generated code.
Ownership is Rust's hardest and most fundamental concept, enabling memory safety without a garbage collector. This article explains ownership, borrowing, and lifetimes in plain English, along with the common situations where beginners end up "fighting the compiler," to help you clear Rust's first and steepest hurdle.
Go's goroutine-and-channel model is simple and powerful, but misuse can cause leaks, deadlocks, and races. This guide covers lightweight goroutines and scheduling, channel synchronization and communication, select multiplexing, worker pools, fan-out, pipelines, and common concurrency traps.
Writing scripts and writing production Python are two different things. This article explains dependency management with uv, poetry, and pip-tools; type annotations and mypy; project structure; pytest; packaging and releases; and the transition from runnable scripts to maintainable engineering projects.
A codemod can rewrite thousands of call sites at once, and just as reliably replicate the same bug. This article builds an executable invariant gate from node selection, semantic preservation, idempotency, format boundaries, and diff budgets.
A plugin that behaves correctly now does not guarantee the next automatic update stays read-only on the repo. This article binds extension artifacts, publisher provenance, permission capabilities, and update generations into an admission contract, using isolated canary runs and revocation drills to control IDE, MCP, and Agent plugin supply chains.
When an Agent pauses, a paragraph of progress description is not enough for a developer to continue safely. This article uses a versioned handoff record bound to the Git worktree, recoverable artifacts, and an explicit acceptance protocol to avoid missing changes, duplicated work, and orphaned responsibility.