Why your local LLM feels dumber than it is
- LLM: 4 events in the last 90 days
- Previous: earlier the same day · Giving an LLM your prod database is easy. Taking access away is the hard part
What happened
Quick Introduction We have all been on forums, chats, reddit, discord, youtube, or somewhere and heard “Oh! Model XYZ is AMAZEBALLZ!zomgwtfbbq” then downloaded it (or more likely, some quantized form of it) and said “eww… This sucks!” This post is going to be a rather technical series of experiments to demonstrate the impact of implementation-specific hazards with inference. I will be using the term “reference imple…
Summary assembled by rule from the sources below
Why it's spreading
- DiscussionCommunity discussion only (1 posts), not yet corroborated
Timeline
- First appeared on Hacker NewsHacker News
Sources
Community
- Why your local LLM feels dumber than it isHacker News