YC's Garry Tan uses AI agents so much, he spends up to $200K a year on tokens
Posted by karakoram 10 hours ago
Comments
Comment by bartread 9 hours ago
I wouldn't say this was the norm, but I have burned through £1k of tokens in a couple of days before. And, on that same gig, I realised a test I was considering running would burn £2.5k worth of tokens over the course of a few hours so spent a couple of hours of my own time re-engineering it to get that down to £150.
The point is that I don't necessarily know that spending a shitload of money on tokens really tells us anything useful. If he's getting a return on that investment, fine, whatever.
Obviously most of us couldn't afford to spend that much ourselves, no matter how much value it might deliver, and many of our employers wouldn't be too happy if we spent it on their dime either. Equally, if you can, and it's delivering real value, then I don't see why you wouldn't?
Comment by plusfour 9 hours ago
details please, if it's interesting
Comment by deadnomore 8 hours ago
Comment by bartread 5 hours ago
Comment by sixtyj 7 hours ago
You can do it if your employer has endless pockets.
Example: $30/1M input tokens (I don’t count output or cache, for simplification), you have several daily agents for everything => 3M tokens daily per agent * 10 agents ~> $900/day => $328k/year (API spending)
Comment by hparadiz 8 hours ago
Comment by nodesocket 8 hours ago
Comment by bartread 5 hours ago
And, in fact, I got it from £2500 to £150 by careful model selection (I ran a trial over a small dataset with different models until I found the least expensive/capable model that would reliably do what I needed), using a local model for one step, and paring down the inputs as well so the token count plummeted.
Comment by jgalt212 3 minutes ago
git clone https://github.com/garrytan/gstack
cd gstack/
git ls-files | xargs wc -lComment by fantasizr 9 hours ago
Comment by johnfn 8 hours ago
Comment by fantasizr 7 hours ago
Comment by ASalazarMX 8 hours ago
Comment by maxbond 9 hours ago
Comment by fantasizr 9 hours ago
Comment by itishappy 9 hours ago
Comment by fantasizr 8 hours ago
Comment by itishappy 8 hours ago
> “It’s too expensive right now,” he said, adding that he knows the amount of money he spends on AI agents is “a crazy privilege that not everyone can do.”
Comment by bix6 8 hours ago
Sleep is one of the most important things in the world. Why not have the agents work while you sleep?
Comment by hackyhacky 8 hours ago
Even better, why not have the agents sleep for you?
EDIT: for those who say this is not realistic, I've had Claude sleep for 10 hours in just 30 seconds. Saved me an entire night.
Comment by Freedom2 8 hours ago
Comment by hackyhacky 7 hours ago
[1] https://www.amazon.com/Million-Plus-Random-Digits-Symbols-Gu...
Comment by trog 4 hours ago
Comment by thephyber 8 hours ago
People in psychosis don't exactly weigh all of the options with a level head. He may not recognize that he has "cyber psychosis" or that his lack of sleep is a bad thing.
Comment by itishappy 8 hours ago
It was productive, but as you say, it's dangerous to gamble with sleep.
Comment by ks2048 9 hours ago
Comment by glennfiedler 9 hours ago
Comment by miltonlost 8 hours ago
This is insane. He's turning the failure of his AI assistants to do what he wants every single time and to do it in a safe manner into a positive thing. Failure as a positive!
Comment by thephyber 8 hours ago
That said, I approach AI with deep skepticism. I try to learn it, including its strengths and weaknesses. But I don't blindly trust it.
Coincidentally, my stock brokerage just yesterday sent an email reminding users that anything their agents do using the user's credentials is the responsibility of the user.
Comment by up2isomorphism 9 hours ago
Comment by Jtsummers 9 hours ago
Comment by bitwize 53 minutes ago
2020s, techbros: "Here's why it's a huge problem for non-billionaires to have things."
Comment by georgemcbay 8 hours ago
Garry Tan is fully aligned with Elon Musk in going after MacKenzie Scott's charitable giving, making spurious arguments that she's doing it in the wrong way when they are all just running cover for the fact that she's one of the few at that level of wealth being charitable at all these days.
Silly woman, she should give her money away the right way, which I guess is by attempting to buy political power.
Comment by Jtsummers 8 hours ago
https://garryslist.org/posts/mackenzie-scott-s-26-billion-su... - The rant itself.
Comment by lovich 2 hours ago
> This isn’t generosity. It’s negligence at scale.
Is when I realized I was wasting my time reading the article
Comment by Hikikomori 3 hours ago
Comment by qwr1 8 hours ago
Software? I'm not aware of anything.
Comment by meindnoch 9 hours ago
Comment by georgemcbay 8 hours ago
"Garry, this is a text file".
Comment by vrganj 9 hours ago
Comment by jgalt212 9 hours ago
Comment by opengrass 7 hours ago
Comment by ShadowOfThePit 9 hours ago
> He describes using AI agents as getting help with “almost anything that you do in your day-to-day life. (...) Almost anything you want to do, it knows you, and it’s there to help. And it will actually sort of run ahead and say, ‘What about this?’ Or it’ll help you see around corners.”
Wow, impressive. Both the capabilities and how much he's willing to share.
Is it worth $17k per month? For me, absolutely not. But people spend more on luxurious cars and such, so if you've got money to spare...
> Y Combinator is also using an agent that is “rebuilding the way we operate at YC. We now have an internal AI agent, for instance, named Stray Light that kind of has a personality, and then it has a company brain. It actually has the total context of every founder we’ve ever backed, anyone who’s ever emailed us, like all the applications.”
Holy anthropomorphization. But besides that, what's the goal of doing this? Keeping a handy overview of when and why someone said something?
Comment by switchers 9 hours ago
Comment by dreadsword 8 hours ago
Comment by timmytokyo 7 hours ago
Comment by pythonaut_16 6 hours ago
The only way I can imagine to burn that many tokens is just to run every task fully through the most expensive LLM with no real strategy. Like indexing emails should be a combo of scripts and small summarizing prompts I'd think.
Comment by randysalami 9 hours ago
Because they can. It’s as simple as that. To find meaning, to feel in control, to win. To dominate.
Comment by SpicyLemonZest 8 hours ago
You'd be surprised how important such an overview can be in relationship-based businesses. People spend a lot of time trying to track down a vague memory they have of someone telling them something. CRM platforms are big for a reason, after all.
Comment by 27183 9 hours ago
Comment by A_D_E_P_T 9 hours ago
(Figures vary, see e.g. https://www.linkedin.com/posts/christham_4-weeks-on-claude-2... for $13,700/mo.)
If you hit your limits on two Max 20x plans, you could very well be exceeding $300k/yr in token use at current API rates.
Comment by pu_pe 9 hours ago
Comment by TiredOfLife 7 hours ago
Comment by hartjer 9 hours ago
Comment by m3kw9 8 hours ago
Comment by stego-tech 8 hours ago
Not cloud costs, though; consumer costs. These agents must run on-device for privacy protections, because anything less will be a global non-starter. That means we need models that excel on phones, tablets, laptops, and desktops; we need home compute modules to run larger, “frontier”-class models for bigger tasks but without guzzling electricity (the Mac Mini’s power envelope is an ideal target); we need smart harnesses that can foist off inference to bigger models elsewhere on your private network of devices as needed without the user prompting for specific thinking modes or model names. All of this has to happen automatically, privately, securely, without leaking data to advertisers or surveillance companies.
It’s hard work, but it’s definitely the future of AI. I would argue the business case is solved with being able to build bespoke stacks of kit and run models through neocloud providers with ZDR policies. It’s the consumer angle that’s hard to crack, because everyone wants a repeat of Web 2.0 for ad-dollars instead of a privacy-centric modern tech stack that forces companies into lower revenue streams.
Comment by Dr_Birdbrain 8 hours ago
The future of personal assistants is most likely akin to Muse Spark, and yes I expect Meta is training on all of those interactions and using them to target ads.
Comment by argee 8 hours ago
I beg to differ.
"People just submitted it. I don't know why. They 'trust me.' Dumb fucks."
- Mark ZuckerbergComment by ex1fm3ta 9 hours ago
Comment by xhkkffbf 9 hours ago
Comment by ShadowOfThePit 9 hours ago
Counter-point, they can't serve as a knowledgeable discussion partner, programmer, search engine, or your personal psychologist. Not saying that they should.
Comment by lbrito 8 hours ago
That's basically gstack
Comment by digitaltrees 9 hours ago
Comment by TiredOfLife 7 hours ago
Comment by wahnfrieden 9 hours ago
Comment by slopinthebag 8 hours ago
Comment by Olumia 1 hour ago
Comment by lambdadelirium 9 hours ago
Comment by ShadowOfThePit 9 hours ago
Also...
> Please don't complain about tangential annoyances—e.g. article or website formats, name collisions, or back-button breakage. They're too common to be interesting.
Comment by siva7 7 hours ago
Comment by trog 4 hours ago
It's pretty obvious $200k/yr in tokens is a ludicrously huge spend. Trying to pretend it's not to show how leet you are is weird. But the interesting topic buried here is what value he's creating with such a spend and how it benchmarks against alternatives.
Because that is the value prop of AI. If it doesn't stand up against options when measured clinically and objectively then what's the point of it
Comment by anoojb 8 hours ago
Gary is rich. Let's assume now, he spends between $10-20K/month USD on tokens. Whether he gets overwhelming tangible value out of that token spend is immaterial.
What he's getting out of it is a mix of social signaling value and actual perceived productivity. I don't know, but I doubt he has measuring the ROI on the token investment.
Much like someone gets various kinds of value out of a a personal tutor for their child. Or a high powered executive who continues to request budget for a "Chief of Staff" and related personnel in 2026.
The question is whether this is signal, or noise. Will everyone who has the budget aspire to spend money on tokens as a subtle way of projecting value with some tangible benefit? How long of a runway does this have?
Much like a Chief of Staff office, there's more to manage...but you you get some tangible benefit by having people to whom you can [in theory] delegate tasks and trust they will be completed. To some degree none of this matters, value is in the eye of the beholder.
What a time to be alive. Rich people continue to spend money with abandon, just on different things.
Edit: I work at technology company. If I were spending $10-20K/month USD in tokens I would immediately get flagged by Finance and receive a note from my EVPs Chief of Staff/Business Admin. My usage and prompts would get audited and I would be asked to create a report justifying the business impact of the spend.
Comment by rcko 7 hours ago
Comment by anoojb 7 hours ago
Does it matter that he's spending this much money on tokens? What's the derived signal? Why isn't he spending more?! Spend on intelligence seems to have no limit, and he's rich after all right? What's the limiting rate of return on token spend for the rich? Does Gary represent an archetype of other rich people who also want to spend money on tokens at that rate? ...if not more?!
Comment by bix6 7 hours ago