Hacker News AI56

Show HN: SlopGrid – Create your own oneshot AI model benchmarks

· 2小时前
AI 摘要

This is something I've been playing with for the last couple days - an app I vibecoded to arrange oneshot LLM visual benchmarks without the need to write any code. I do it form my phone so the excellence of mobile UI is high in the priority list. It is inspired by Simon Willison's benchmark writeups[0], basically you can recreate them in one go. Besides text and images, it supports SVG outputs and whole static websites, which is where benchmarks get the most interesting. Additionally, I added the ability to alter chat history for the chat completion API, which I think is useful for model red teaming (or if you just want to see how different models apologize) - but I haven't found any impressive uses of that feature yet. This thing helped me improve my intuition on different SOTA models' strengths and weaknesses; check out the various examples on the website, and feel free to create your own [0] https://simonwillison.net/tags/svg/ Comments URL: https://news.ycombinator.com/item?id=50118127 Points: 1 # Comments: 0

查看原文(Hacker News AI)