- LLM API calls hang for minutes: client timeouts, retries and connection limits in the OpenAI SDK and boto3AI & GenAI · 8 Nov 2026
- Why your chatbot forgets: LLM chat history basics, trimming and summaries in PythonAI & GenAI · 7 Nov 2026
- Your first Amazon Bedrock call: the Converse API with Python and boto3AI & GenAI · 7 Nov 2026
- Amazon Bedrock ThrottlingException below your TPM quota: max_tokens reservations, burndown rates and burstsAI & GenAI · 6 Nov 2026
- Azure OpenAI first call from Python: use Entra ID and get the deployment name rightAI & GenAI · 6 Nov 2026
- Estimate LLM token costs before you roll out: a simple method with PythonAI & GenAI · 6 Nov 2026
- Azure OpenAI deployment creation fails: InsufficientQuota, model not available in region and policy denialsAI & GenAI · 3 Nov 2026
- LiteLLM proxy virtual keys: per-team budgets, model access and rate limitsAI & GenAI · 3 Nov 2026
- LLM answers cut off mid-sentence: finish_reason length, max_tokens, reasoning tokens and context limitsAI & GenAI · 3 Nov 2026
- Introduction to LLM guardrails: input checks, output checks and tool limits for a production chatbotAI & GenAI · 2 Nov 2026
- LLM streaming responses arrive all at once: SSE buffered by NGINX, Application Gateway, API Management or Front DoorAI & GenAI · 2 Nov 2026
- Token counts don't match the bill: why tiktoken estimates differ from the usage your LLM API reportsAI & GenAI · 31 Oct 2026
- LLM API basics: your first call, messages and roles, tokens, temperature and max tokensAI & GenAI · 29 Oct 2026
- Prompt writing basics for IT ops engineers: clear instructions, context, examples and output formatsAI & GenAI · 29 Oct 2026
- RAG basics: how retrieval augmented generation works, with a minimal pipeline you can read in one sittingAI & GenAI · 29 Oct 2026
- Same prompt, different answer at temperature 0: where LLM non-determinism comes from and how to live with itAI & GenAI · 28 Oct 2026
- Azure OpenAI CLI cheat sheet: accounts, deployments, quota, keys, metrics and logsAI & GenAI · 27 Oct 2026
- LLM streaming broken behind a proxy: answers arrive all at once or cut off mid-sentenceAI & GenAI · 27 Oct 2026
- MCP server not connecting or tools missing: fixing stdio, Streamable HTTP and auth failuresAI & GenAI · 27 Oct 2026
- Amazon Bedrock CLI cheat sheet: models, test calls, guardrails, logging, metrics and quotasAI & GenAI · 26 Oct 2026
- Advisory: choosing an LLM for a use case - hosted or open-weight, model size, and selecting by evaluationAI & GenAI · 25 Oct 2026
- Optimization: model routing and cascades - send each request to the smallest model that does it wellAI & GenAI · 25 Oct 2026
- Optimization: provider prompt caching - structure prompts so the long, stable part is reusedAI & GenAI · 25 Oct 2026
- Redact PII from LLM prompts and logs with PresidioAI & GenAI · 24 Oct 2026
- Amazon Bedrock AccessDeniedException: model access, IAM and regionsAI & GenAI · 22 Oct 2026
- Azure OpenAI content filter errors: why legitimate prompts get blockedAI & GenAI · 22 Oct 2026
- context_length_exceeded and max token errors: fixing long prompts and cut-off answersAI & GenAI · 22 Oct 2026
- Evaluating LLM answers with LLM-as-a-judge: a practical setupAI & GenAI · 22 Oct 2026
- LLM fallback models and circuit breakers in application codeAI & GenAI · 22 Oct 2026
- LLM tool calling fails: wrong tool, bad arguments or endless loopsAI & GenAI · 22 Oct 2026
- OCI Generative AI: policies, regions and common API errorsAI & GenAI · 22 Oct 2026
- Prompt injection defense checklist for production LLM appsAI & GenAI · 22 Oct 2026
- Running self-hosted LLMs with vLLM: GPU memory, KV cache and the metrics that matterAI & GenAI · 22 Oct 2026
- Semantic caching for LLM apps: cut cost and latency without serving wrong answersAI & GenAI · 22 Oct 2026
- Tracing LLM applications with OpenTelemetry: see every prompt, retrieval and tool callAI & GenAI · 22 Oct 2026
- Your support chatbot is making things up: diagnosing and reducing hallucinationsAI & GenAI · 22 Oct 2026
- Handling 429s and latency spikes from LLM APIsAI & GenAI · 19 Oct 2026
- Running a RAG pipeline in production: an operations checklistAI & GenAI · 10 Oct 2026