My business partner sent a 5K vibe-coded PR that he didn't even test
Posted by yhcj 12 hours ago
Comments
Comment by aogaili 1 hour ago
This was not feasible a year ago.
Now, regarding the quality of the code, the edge cases etc, surely someone familiar with the failure modes can review and prompt the AI better. But that doesn't negate the fact that these people are producing huge amount of code using natural language without any programming background.
A skill that used to take many months (if not years to master) and require handcrafting the software line by line is now done in English with almost no understanding of programming primitives.
And I'd argue that if the models, harnesses and IDEs keep getting better then a layman learning few software best practices would outperform a team of senior developers writing code manually.
Therefore, the developers refusing to adapt and adjust will find themselves gradually in a position where a layman can easily outperform their economic output by a huge margins. And in my opinion, the author just found himself in this position, and still in denial of what is happening.
Comment by potro 15 minutes ago
Huge amount of *non-working* code, as illustrated by this article.
Also author is not super clear on this point, but according to article the partner has programming background.
Comment by aogaili 7 minutes ago
The issue here is that the author is now forced to use AI to review the 5k lines and he seems to opposed to the idea hence my point that these developers will eventually be forced to adapt.
Comment by Valodim 7 hours ago
Or, if you have reason to believe he's got what it takes - treat it like an leaving opportunity, give him room to make mistakes. This is, ime, what a rookie AI user mistake looks like.
It is easy to get carried away by the momentum. Many have fallen into that trap, not all are irredeemably bad software engineers.
Comment by greggoB 6 hours ago
I see the take quite often on HN, and I have a major gripe with it. Yes, people were lazy and we had these problems before LLMs hit the scene, but clearly there has been a sea-change in both the frequency and degree of this behaviour since.
A problem can both exist independent of a catalyst and be exacerbated by it. Arguments that try to window-dress this away are not particularly productive.
Comment by piva00 2 hours ago
A simple example: with picture editing software people have been able to create believable fake content for a long time, it did require skill which limited the scale, with genAI creating in seconds, by anyone, a much more plausible fake image than most people were able to before creates a whole other kind of problem that didn't exist before.
It's a tired argument to reduce issues to analogous which existed before and discard how the scale and degree of it changes the class of problem...
Comment by encyclopedism 3 hours ago
Human behaviour is complex. Patterns of behaviour that occur in general (there are always outliers of course) dictate so much in society, culture, politics and inter-human relations. Changing these behavioural patterns will affect meaningful real world change.
Social media has affected change in human behaviour. I suspect AI will too. We are starting to see the first shoots of the changes AI will bring.
Human behaviour on the average will choose convenience over effort. It is very difficult to buck this trend societally. To be clear, AI provides an immense amount of convenience.
Comment by vidarh 2 hours ago
I just yesterday had an agent produce a prototype that appeared to work and that looked plausibly well engineered, except I knew from experience that what it had done should be doable with a tenth of the codebase.
Someone without experience might've just accepted that prototype. It took one prompt to get it turned into a reasonable MVP, but you'd need to know what to ask, and you'd need to know you needed to ask.
Comment by p2detar 5 hours ago
Comment by greggoB 4 hours ago
I'm not sure I understand this correctly, but I assume it means blaming the agents? If so, that's not my point - I'm describing how many people are using them to be lazy, which shouldn't be particularly controversial.
To your other question: if OP had gotten half the size PR to go through, that sounds more manageable to me? If they had gotten nothing, that could be a useful signal about the capability of their business partner, worth knowing now rather than later. Could one imagine a situation where AI enables a thoughtful business partner to provide more value? Absolutely. Should this be the default assumption? I'd argue that it absolutely shouldn't.
Comment by yhcj 5 hours ago
This is all but gone
Comment by greggoB 4 hours ago
Comment by hombre_fatal 5 hours ago
It’s still shocking to me pre-AI how often people would ship code they didn’t bother to run once, relying on some QA stage to report an issue.
With AI the solution to it is also trivial since an extra three seconds spent writing a prompt could have had the agent run and verify it.
Comment by greggoB 5 hours ago
This just recurses the original problem by an additional step: assuming someone is even bothered to write the prompt, they are just as unlikely as before to check what it spits out.
AI may be a productivity amplifier for some, but I don't think it's far-fetched to describe it as a laziness magnifier for the majority.
Comment by yhcj 12 hours ago
I am one of those neurodivergent people who loves programming because it gives me the right stimulation.
I also enjoy drawing, gardening, and exercise.
I don't own a car because I love walking, and such.
So I'm wondering if it's time to call it quits with programming (for a living).
Luckily I have some savings and I have other interests from years of doing random jobs and businesses, and as much as I love programming, especially with others, I think very few of us still want to program.
I'm like the Last Samurai of programming while everyone is using AI-assisted gattling guns.
Is it time to let go?
Comment by tpxl 6 hours ago
Two things you can do regarding programming here.
1. Be a consultant for a high wage, use AI, produce good results quickly - little to negative intellectual joy here. You still have the edge here due to good taste.
2. Produce 'artisanal' code in your spare time. Work 3 months for pay, then 9 months on whatever projects scratch your itch.
I still want to program and I don't think it's time to let go. Hit me up (email in bio) if you wanna chat, you sound like a really interesting bloke.
Comment by sillyfluke 4 hours ago
Comment by evolve-maz 6 hours ago
Sorry to hear you're having a rough time with work. I do think AI availability has made otherwise smart people put out lazy work. But I also think that there are more people who still "code by hand" than you think.
You might find some joy by going to certain events where people talk about different items coding-wise. I enjoyed the talks for this conference recently https://www.youtube.com/@softwareshouldwork (particularly Richard Hipp's, Delaney Gillilan's and Carson Gross' talks), maybe you can find similar spaces. The benefit has been Youtube's algorithm recommending me better software talks now too.
Comment by grebc 6 hours ago
I bought a seriously derelict property in country Australia and am having a good time slowly fixing it up.
I’ll get back to programming next year, hopefully the blow-ins have moved on to the next hype cycle by that time.
Comment by JodieBenitez 4 hours ago
"C’est une folie de haïr toutes les roses parce qu’une épine vous a piqué."
Comment by vova_hn2 7 hours ago
A small (and a bit tangential) personal story: I thought I am one of those people who care about the result, more then about the process.
But, I've recently played a game called "The Farmer Was Replaced" that someone mentioned in the comments in one of the posts here, on HN.
The game is basically a farming sim, except you farm by programming a drone using a Python-like language.
Of course, I didn't use AI, because where is the fan in this? In "normal life" (work, personal projects), it is very hard for me to convince myself to do anything manually, because generating code is more efficient. But in a game, using AI assistance would be like using aimbot in a shooter or a cheatcode in some other game. Yeah, it's much more efficient, but what is the point? There is no challenge and no fun that comes from overcoming the challenge.
So, anyway, I was writing code by hand for the first time in I-don't-even-remember-how-many years. And it was so much fun. I don't remember when was the last time I felt so engaged, so immersed, so "in the flow".
So, yeah. After all, maybe I'm not a ruthless pragmatic who only cares about the final result and doesn't gives a shit, how did he get there...
Comment by bitwize 5 hours ago
But HOLY SHIT THE DOPAMINE RUSH. Just crafting things and making them appear on the screen with a few statements... It was like I was a kid again. I remembered why I liked programming.
It's like... AI is a cheatcode. It's iddqd. Sure, you can cakewalk through a level with it on, but are you really playing the game, then? You certainly haven't gotten better by doing so, and you haven't experienced the involuntary buttcheek clench when you hear a cacodemon hiss from behind you... The whole point of programming is the new things I can do by having gone through the exercise of figuring it out. The ways I've grown, the glimpses I've gotten into the world.
Comment by ldng 6 hours ago
Comment by 59nadir 6 hours ago
I just got back to working on a project I like where we don't use any LLMs for code generation because we think it kind of sucks and leads to bad results unless it's for incredibly small contexts (which is usually not worth the prompting).
You're also not as alone as you think in actually liking programming enough to do it by hand even after having used LLMs. There's also the fact that you build more theory up by actually writing the code anyway, so someone who actually wants to know their code base intimitely will always have to write the code.
Comment by dist-epoch 6 hours ago
Comment by aprilthird2021 8 hours ago
I mean, if you want to retire go ahead, but don't do it because of AI. AI is just a tool to generate code faster. It doesn't replace the work of actually making design decisions and knowing what will scale and what's better going forward vs what will work now but spiral into unmanageable spaghetti code soon (yes AIs also have a harder time managing messy code than neat code)
Comment by probably_wrong 8 hours ago
In my last round of job search this year no one asked me questions about good software practices but they did ask me how proficient I was with AI agents. And let's not forget that we are part of an industry whose motto is "move fast and break things". Sure, NASA has a zero-bugs approach to software dev, but they don't have room for all of us.
Comment by XenophileJKO 7 hours ago
It was pretty simple to project the compounding effects and headroom that we had. I go back and forth on this all the time.
There probably won't be much demand for "un-fuckers". Up until recently I thought knowing what to build for a given context would give you quite a bit of runway.
I still think knowing what you should build will be important for the next 12-24 months.. but I have to be honest.. after that.. I don't know.
I don't know how to feel myself. I'm certainly an "ideas" guy as well as a nitty gritty build it guy. I just think my technical side is depreciating very rapidly.
Comment by rubzah 5 hours ago
Comment by aprilthird2021 2 hours ago
Not really. They're only as good as whatever they are prompted for. If you prompt them for the wrong thing, they'll do it. Great tools, human error
Comment by aprilthird2021 2 hours ago
I'll bet we'll all still work in software in 24 months
Comment by aprilthird2021 2 hours ago
That's not what I've said though.
> "sometimes things are broken, are then fixed with a broken solution, and will remain broken till the end of time".
That's true of a lot of software. But the big bucks things right now have too much money riding on them to be broken and remain broken. Every big tech co right now is talking about and sharing solutions for how to handle the wave of AI generated code that hits their systems from internal devs every day. Reliability is not at levels it was before. Change safety is far more challenging. Move fast and break things was shelved long ago at these companies. It's only popular in the public imagination.
That's not to say these companies will stop using AI. Absolutely not. It's a great tool, but like all tools it needs an ecosystem built around it. It needs evals, debugging, maintenance, telemetry, etc. It ultimately needs goals and directions driven by human beings who understand the domain well enough to steer. And that's why devs like OP are important now and will remain so for quite a while bc the rise of AI is the rise of many new and challenging engineering problems.
> In my last round of job search this year no one asked me questions about good software practices but they did ask me how proficient I was with AI agents
So what? How does this change anything I said? Being proficient with AI agents is far easier if you have the domain knowledge about what they should produce and far harder if you have no idea.
And anyways, what you're asked in interviews is not a mirror of the job. I see many people every day at work who are lauded and praised for using their knowledge to course correct and improve AI agents and other AI workflows. The idea that there will come a point where they work perfectly and don't need to be messed with, well that's also true of software and services. But it doesn't mean big tech companies with quite stable main services just stopped hiring people years and years ago
Comment by kakacik 7 hours ago
Banks will not work like that for next 10 years at least. The tiny amount of money one could save on those big banking projects by using llms aggressively will bite back immediately when shit just doesn't work, clients leave for good and regulators will fine you to the ground (or remove your banking license). Many other businesses who are not race to the bottom and realize how crucial reliable IT is to their business also won't go that way anytime soon.
World is not ending, there is some transformation and thats about it. Its true there will be much less jobs for devs but its mostly affecting newcomers. Statistical models are not making code better than experienced humans, and won't for some time if ever.
Comment by lmz 6 hours ago
Not sure what business you are in but the non tech industries (corporate IT, in house apps) have not, in general, been associated with quality. Cost cutting, outsourcing to the lowest bidder: yes. Quality: no.
Comment by kakacik 5 hours ago
Its true budgets are often the problem, but not much 'move fast and break things' mantra of SV, rather 'move as much as low budget and corresponding quality and bureaucracy allows you to'
Comment by netdevphoenix 6 hours ago
Comment by cpursley 5 hours ago
Comment by Our_Benefactors 8 hours ago
Comment by aprilthird2021 2 hours ago
Oh look a thing I never said being refuted
Comment by cladopa 5 hours ago
When I had partners in my business I studied them first deeply like I was going to marry them because I WAS going to marry them!
You should agree on your values or else the company will go nowhere. One founder will raw one way and the other the opposite making the boat to stay in the same place.
I have a software company and the opposite problem: I am obsessive about testing and meta programming. We write way more testing code than code, we automate everything with meta programming.
It was clear several times that we tested and automated way more than necessary. We automated things that only used once for example(although we used later multiple times on other projects).
So we had not the usual problems than companies have like bloat or security vulnerabilities but we had the problem of having software that was was super expensive because we did double or triple the code than the competition with tests that developers hated(they are boring to write). Our software took also way more time to market.
Companies love to buy the cheapest they can today and tomorrow we will see, so that put us in a difficult position. It was specially hard at first, but then this principles gave us an edge(because most companies would compromise early and not reap the benefits later).
Had I a business partner with a different mindset and beliefs, it would have been impossible to me not to change course of the boat in hard times.
BTW we use LLMs with great success. It let's us test even more spending way less than before.
Comment by yhcj 5 hours ago
It's sad because I've known this guy for 20 years and since the beginning he had a tendency towards "work smarter, not harder", a good motto at the time you're 20 but I often saw it crippling him in the long run, while having short-term gains.
Long-term, funny enough, he said he wanted back into this project because he was very unsatisfied with "easy money" (we both got into SEO at the right time and made a ton of easy money) and wants something stimulating for his brain.
In the meantime I had kids, worked my ass off to get the health and fitness level I want (he also wants it... alas nothing changes).
I'm kind of quite committed to this and we're maybe 30% away from finishing, but I almost debate sometimes if I should just do the FE vibe-coded and let him see that it won't be as good as I can manually do it (FE is hard in the end). Just get it out of the door, keep the customers that we have and let it kind of die down.
Comment by socketcluster 6 hours ago
Just watch the software engineers who say "Let's be careful" lose their jobs and get replaced by non-technical vibe-coders churning out 10K lines of dirty insecure, unmaintainable code per day... Ticking time bomb.
I swear, good engineers are going to move to North Korea to monetize because of the amount and size of 'opportunities' this will create.
It seems so far-fetched but that's the direction it seems to be heading.
Comment by yhcj 5 hours ago
What I fear is that it's impossible for the untrained to see the difference between a highly-technical developer and the vibe-coder.
Software is so buggy nowadays (just look at Facebook, or Facebook Ads. Crazy) I wonder what's going to happen in the long run.
I was banking on the opportunities it will create but nah, have you tried debugging AI-generated codes of thousands of lines where the original dev doesn't exist? It's a mess I don't wanna clean up.
Comment by socketcluster 3 hours ago
Seems we're on the same wavelength because I had the exact same thought about this.
But actually, I'm probably not so fussy. I wouldn't mind cleaning up the mess if I'm paid hourly... But now my concern is: What if they want me to clean up the mess but demand that I do it in a particular way which makes it impossible?
I'm already seeing signs of this. This was already kind of the case in my last job; I had to fix things and implement new features but we had to keep the same clunky, over-engineered architecture. My current job doesn't have the same degree of architectural legacy baggage but there is a lot of bureaucracy to deal with instead, which is itself restrictive.
Comment by ckvibubueu 6 hours ago
Comment by p2detar 5 hours ago
Comment by yhcj 5 hours ago
Comment by dreieinsvier 6 hours ago
Programming by hand is one way (it also works with AI), to make decisions. Decisions about scalability, maintainability and sanity of your software. And still this will pay off!
To me it sounds as if he is a very bad software engineer.
Comment by crnkofe 6 hours ago
Comment by pentaphobe 3 hours ago
A lot of very quick "AI is not the problem" responses (and all in their own top threads. writing rather than conversing.. perhaps a pattern there? but I digress)
Agree with the pretext that some problems may be due to bad habits being amplified
But to me that default chorus of the "you're holding it wrong" thought-terminating cliche sounds no different to
"social media is not an issue, people just need to use control" or "ads are not the issue here, just ignore them.."
Or "hey, the button which randomly gives the pigeon seeds when pushed is not the issue here, pigeons just shouldn't be so needy"
Also I've seen good engineers (and non-engineers) get swept up in the "magic" of genai progressively lose chunks of their formerly consistent, and long-standing good behaviours
Comment by p2detar 5 hours ago
> THIS is what I am so against when people use AI for everything.
This sounds horrendous but can we please stop equating vibe-coding to AI-assisted coding? They are not the same thing. It's one thing to submit 5K vibe-coded untested PR and another thing to use AI to add functionality in a granular way that you can review, or generate boilerplate, or test your ideas and scrap them if they suck and so on.
Comment by yhcj 5 hours ago
Then yesterday when I started asking him questions about how certain stuff worked, he had absolutely no clue.
He didn't even read the docs summarizing what the PR did.
In his mind AI is just assisting him. It's just like the alcoholic saying "one more drink won't harm me, I can quit any time".
Comment by p2detar 4 hours ago
I do have a similar case at work, but it's my superior in that case - shipping large volumes of code with Claude, 100% vibed. It's slightly different in the sense of him having almost no clue about programming but having very well self-organization and discipline. Rigorously documents his work (with Claude of course) and commits his Claude sessions in the repo. Funny enough we got 2 paying customers for one the projects he vibed. It blew my mind. I don't know how this will play out, but it's been a bit scary and pushed a lot of us to do more with AI rather than manual coding. I still can't get myself to commit to 100% vibe-coded stuff though.
Comment by k310 12 hours ago
I gather that you don't have the "juice" to demand better. Even AI testing AI would be better (in some parallel universe?) than not testing at all.
So become a consultant, preaching the simple gospel of "test this goddamn thing before unleashing it, or the tougher gospel of "Well if AI is doing all the work, then why don't you find a job that tolerates garbage?"
I almost always had more responsibility than authority, except for a job where I actually had a field team. They were laid off by the "authorities" in order of greatest competence first and I ended up with one guy who made countless goofs, like creating overlapping disk partitions. I ended up redoing all his work, more than doubling my load. Does that sound familiar?
In your case, it sounds like you will end up similarly, unless you find a way get your management to establish a "No broken shit" rule. I know that's daunting, and in many jobs, I could only finagle minor changes, usually by talking with other people more tenured, who had a piece of management's ear.
If it amounts to "I must double my work or this all falls apart" while your partner pushes buttons (my charge was a "button-pusher"), then leave, and good luck.
But do give it one college try to get some sanity into the system.
Comment by yhcj 12 hours ago
I did work as an Engineering Manager for a bit but honestly hated it with my guts. Promised myself I would never do that again. I have two young children so they're a bigger priority right now.
Not to sound pretentious but I was top 10 in my country (for example, I read a 500-page book on Assembly language the night before and aced a test that 90% of people failed) so it's really hard for me to work with people who don't get things as fast as I do.
Nothing to brag as it really isn't all hard work, I'm just quite neurodivergent compared to the average. It comes with A LOT of downsides (some nights I only sleep 2 hours because I came up with the solution to a hard problem while I was asleep and wake up to code it and it works)
Now, all this is because I am now at a crossroad where I have enough money and life experience in other jobs (I stopped programming for 10 years in fact because I had a pretty successful business).
The sad part is that I rekindled my love with programming in the last decade (I'm past 40), but it might be time to let it go and go back to doing business.
EDIT: I did work as a consultant (reluctantly) and was charging $500/hr because I really didn't like it but the demand was there. With the economy not being what it was and all the "AI prompt vibe coders" etc blah blah out there I don't really know what's a good rate now.
Comment by k310 9 hours ago
I'm a real old-timer and really wanted that kind of leap for a long time, and delved into scripting languages and even dataflow as in the old Prograph [0], but did mostly sysadmin kinds of chores, with some very fun scientific simulations (so that upper management, even older than I was) could use them, in Hypercard, and that dead-ended.
If the next step is to build upon "building blocks" I'd like to see THOSE blocks thoroughly tested, as math libraries are to a great degree, and not ad-hoc. The most annoying thing I find about LLM's is their propensity to reinvent wheels every time. This may be inherent in the design, I don't know. But a serious business or other project should insist on reliable reusable blocks.
Perhaps the current situation is more like rounding up animals after they broke out of the zoo than caring for them, before it stabilizes if it ever does.
I nag people here to meet some real unmet needs, particularly for seniors, not just because I am one, but because I have had a lot of ideas on what to do, especially about building community and services. The internet is just too savage a place for most. I'll bet that the people approaching senior status will bitch about the lack of real self-driving cars, exoskeletons, and fraud-proof networks of trust, compared to the chainsaw internet of scams --- that THEY could have solved.
Create a "programmable internet" to get around all the annoyances, traps and dark patterns? I do it all the time, working around annoyances, popups, scams, paywalls. The average person isn't going to be able to do these things, not even with the leveling up of programming, but perhaps via proxy. Just as everyone seems to be putting up a shield, with endless CAPTCHAS (and I have browser extentions to solve these relentless eye exams) maybe users need a shield themselves.
But I ramble.
Good luck in whatever you decide to do.
Tally your strengths and strongest interests. Enjoy your family. I was posting elsewhere about some of the insane managers I've endured but memories and photos (some scanned from the film days) of being a parent are the real heart and soul of life. I have read some really insightful articles on what skills will be needed in the next few years and I'll summarize as I make sense of them.
Comment by marcta 9 hours ago
Comment by k310 4 hours ago
Unfortunately, there is demand for people who know to sanity check things. It's not glamorous, but neither is damage control.
Comment by yhcj 5 hours ago
Comment by mcphage 3 hours ago
Comment by josefritzishere 1 hour ago
Comment by TacticalCoder 5 hours ago
Wanna know the answer of those who lost all their brain cells to that?
"If there are bugs, it's only because the prompt was off. I'm a better prompt-engineer than your business partner, so this could never ever happen to me."
And off to the couch they go sit and shut their brains off.
Comment by GJR 7 hours ago
Comment by yhcj 5 hours ago
You like those who agree with you more than those who disagree, but real-life learning doesn't come from everyone telling you you are correct all the time.
I believe we're at the point of no return where he didn't ask me a single question before sending a 5K LOC PR
Comment by onesandofgrain 7 hours ago
Comment by haukebri 7 hours ago
Comment by misiek08 6 hours ago
Comment by dist-epoch 6 hours ago
so, would you say "no worries man I know what I'm doing" about how you use AI?
Comment by mbrumlow 8 hours ago
Simply put you still need good practices to produce working good code with AI.
Oddly what I have found best is patterns that many would cringe and demeans unit test and integration test.
Yes I still vibe unit test and integration test, but more than ever I have to put on my PM and QA hat, even more so with web dev.
For me the only part of the process that has changed is I don’t write the code. I still setup environments to run the code, I still manually poke at things I suspect will be fragile. But most importantly I still always run the software before shipping it.
Comment by netdevphoenix 5 hours ago
False sense of security. What's stopping the agents from doing an elaborate form of "Assert.IsTrue(true)" in some/most/all of the tests since you are vibing it and not reviewing it?
Comment by orwin 5 hours ago
Comment by lxgr 5 hours ago
Comment by netdevphoenix 3 hours ago
Comment by Frieren 5 hours ago
Except that it is the enabler. Without AI there are no 5K lines of code that no human has ever seen. AI introduces a new category of problem that did not exist before.
Comment by Keyframe 7 hours ago
Comment by ubercore 6 hours ago
But the underlying bad practices _will_ bite the same they would have before AI, you just don't know when.
It's a really frustrating state of the industry to be in.