You'll need nerves of steel to work with AI agents

Posted by theorchid 1 hour ago

Counter16Comment7OpenOriginal

Comments

Comment by anonymous908213 3 minutes ago

Luna is unusable garbage. When I see people in threads talking about how useful Luna is for all of their tasks and it's so cheap and fast, it reads to me like people relating anecdotes about how tasty the garbage scraps they're eating out of the dumpster behind McD's is. Sol Max is the threshold of "just barely usable", and even then it's certainly not what the people are hyping it up to be.

> But GPT also offers a $100 plan with five times the usage limits. And how long would that last me?

Sol usage is basically unlimited on the $100 plan if you're human-in-the-loop, reviewing the code, and not doing some useless Gas Town crime against humanity.

Comment by socketcluster 29 minutes ago

It just gets worse as your codebase grows with more code and more files especially. It's like a human developer who is under intense time pressure. If the codebase is large, it might miss an existing function and implement a second one... or it might miss the fact that a database table already exists to solve its current problem and create another one. The solution is to keep the codebase as simple and small as possible and name everything as intuitively as possible with proper separation of concerns. Same principles which were useful before AI are still useful with AI.

Comment by anself 17 minutes ago

Most of these issues are vastly improved or mitigated by adding clear instructions in AGENTS.md.

I follow a specific process with agents, and it works reasonably well: 1) describe my intended feature or change and then say “please recapitulate my intention and write an implementation plan” 2) read the plan carefully and refine it, make any corrections 3) tell the agent to go, but I check in frequently as it’s going. I watch the stream of thought and make course corrections or pull it out of rabbit holes 4) carefully review the result. Checking that tests actually fail, removing unnecessary changes 5) add instructions in AGENTS.md if I’ve found a new behavior that needs redirection

Comment by greenowl 9 minutes ago

Honest question: how much time are you saving versus ignoring that all of this exists and instead just jumping right in and coding yourself?

Comment by saulpw 3 minutes ago

At first, maybe not much. But when you're properly set up, it's amazing to watch it cook.

Comment by fn-mote 4 minutes ago

Unlike the OP, this makes using an agent actually sound useful.

My summary of the article: I use a really cheap LLM, and suffer like everyone else using GPT 3.1. This is definitely a throwback to the days not so long ago when LLMs were completely incompetent.

Comment by dognotdog 1 hour ago

Sounds exactly like the fever dream I see everybody live, lol