Home/Tags/DevOps

#DevOps

Collection

This aggregates CodeNodeX AI community articles and discussions related to DevOps, covering concept explanations, tool comparisons, engineering practices, common issues, and indie hacking experience.

If you're researching DevOps, start with high-quality long-form articles, then join post discussions for a complete understanding-to-practice path.

@admin·5 min read·Agent Engineering

Long-Running Tool Calls: The Terminal-State Protocol for Operation, Poll, and Cancel

After the initial request times out, the tool may still be running server-side; issuing a cancel does not mean the side effects have stopped. This article establishes an operation identity, polling watermark, cancellation race handling, and a single terminal-state acceptance point for a single long-running tool call.

#AI Agent #MCP #DevOps♥ 130 comments
@admin·11 min read·AI Frontier

LLM Batch Inference and Offline Jobs

Not every LLM task needs to run in real time. Batch classification, summarization, labeling, and content generation can cost half as much with Batch APIs. This article covers OpenAI and Anthropic Batch APIs, self-hosted batching with vLLM, job pipelines, and real-time vs. batch tradeoffs.

#AI #DevOps♥ 190 comments