Ask HN: Can anyone run frontier AI models at usable speeds?

Eight months ago, EXO labs promised fast inference on local hardware. But it is not fast enough. It takes a minute and a half to get a response through hermes, using Kimi K2.6. Is there hardware that a dev can buy that can actually offset cloud bills? Comments URL: https://news.ycombinator.com/item?id=50394913 Points: 1 # Comments: 0