使用 Ray LLM Deep Learning Containers 运行多节点推理工作负载
了解如何在 Amazon EKS 上使用多节点 Ray LLM Deep Learning Containers，将一个大型语言模型部署到两个 GPU 节点上，并在一个兼容 OpenAI 的端点后配置独立的预填充节点和解码节点。预构建容器附带完整的推理技术栈，因此您只需配置部署，无需自行组装。
全部动态
本页 40 条10月13日 周二
使用 llama.cpp 在 Amazon SageMaker AI 上部署决策模型
了解如何使用 llama.cpp 在 Amazon SageMaker AI 上部署决策模型。本技术教程将通过用于 llama.cpp 的 AWS Deep Learning Container 提供兼容 OpenAI 的聊天补全服务，然后使用 SemIf 扩展运行时，以便在 CPU 或 GPU 上返回针对已声明选项的概率。
Phasis develops platform for agentic orientation using World APIs and reality layers
When the founders at Phasis Inc. sought to develop a platform for orienting AI agents, they turned to graphs as a way to obtain a measurement of culture. The company wanted to better understand relations not just between people, but between a person and their values, beliefs and subcultures. The goal was to map culture […] The post Phasis develops platform for agentic orientation using World APIs and reality layers appeared first on SiliconANGLE .
10月12日 周一
Microsoft plans to scale its own Maia AI chips to gigawatt levels by 2027
Microsoft will make its in-house Azure Maia chips the main AI inference system across its products starting in 2027, deploying them at multi-gigawatt scale. The upcoming Maia 300 should deliver 40 percent more tokens per megawatt than leading GPU systems. CEO Satya Nadella calls it "our biggest bet yet on our own silicon." The article Microsoft plans to scale its own Maia AI chips to gigawatt levels by 2027 appeared first on The Decoder .
This AI startup says it can generate permit-ready blueprints in minutes
Blueprints AI, a bootstrapped startup based in Santa Monica, developed software that produces code-compliant construction blueprints from a photo, PDF, or sketch.
Microsoft president says UK is best placed to drive AI regulation
Microsoft President Brad Smith calls for urgent AI regulation, saying milk and washing machines have more oversight than AI companies.
OCP 全球峰会：随着生态系统广泛采用，NVIDIA 开放 Vera Rubin 架构，助力全球 AI 工厂规模化扩展
随着 AI 工厂从兆瓦级发展到吉瓦级，其建设所需已不止于先进的计算技术。开放标准正帮助业界更快速、更高效、更可靠地扩展 AI 基础设施。在 San Jose McEnery Convention Center 举行的 Open Compute Project（OCP）全球峰会上，NVIDIA 宣布了新的合作伙伴关系及贡献，旨在 […]
Show HN: Baa – a menu bar app that frees RAM your AI agents forgot about
i built this because my mac keeps running out of RAM every 2 hours and i typically get around it by closing random apps and hoping it will help. :') baa sits in the menu bar and: - finds stuff still eating memory after its app or terminal closed, or that ai agents started and forgot (dev servers, headless browsers) - shows how much you'd get back and frees it in one click - warns you a few minutes before you run out - also finds dev junk on your disk (old builds, package caches etc.) open source and nothing leaves your machine. would love feedback! baa would've cleared ~50gb on my mac :) Comments URL: https://news.ycombinator.com/item?id=50057241 Points: 1 # Comments: 0
Show HN: Remove AI Metadata Offline in Browser
FreeAiWiper processes your files and removes AI watermarks and metadata fully on your browser. at the moment we support various image, video and document types. Comments URL: https://news.ycombinator.com/item?id=50056263 Points: 1 # Comments: 0
TechCrunch Disrupt 2026 starts tomorrow: Your final chance to secure up to $100 ticket savings
Tomorrow at 8 a.m. PT, it all begins. 10,000+ founders, investors, and tech operators will gather at San Francisco’s Moscone West for TechCrunch Disrupt 2026 for three days of ideas, connections, and startups shaping what comes next. This is your last 24 hours to secure ticket savings of up to $100, and get 50% off a second.
Ask HN: How do you manage technical debt when coding with AI?
Comments URL: https://news.ycombinator.com/item?id=50055864 Points: 2 # Comments: 2