Malware uses LLMs to rank victims by how much they're worth
Posted by khalidkhair 1 day ago
Comments
Comment by akersten 1 day ago
Makes me want to have like 5 separate computers:
- one for banking only
- one for development only
- one for web browsing only
- one for gaming only
- one for socials only
How else can you stay safe against a threat that exfiltrates your entire digital life in like 10 seconds?
Comment by DotNetCorePowa 1 day ago
Before, people were responsible for the dependencies they were importing.
With npm and all the javascripters flooding the market, it became normal to be irresponsible "because everybody is doing it".
Fast-forward a couple of years, now everything is web based, even the stand-alone app version. No one knows what is running on own computer, even the Devs themselves don't know what the are asking you to run...
With a pinch of vibe coding on top, and thats the end.
We took 40 years for our industry to be taken seriously, it's all gone now.
Comment by hibikir 1 day ago
What makes npm a more relevant target is a much smaller standard library and thinner dependencies, leading to more chances that a random project will have code of suspicious provenance. The vast majority of what a backend Java project depends on was probably written either by the same 3 companies, or large, established OSS repos. So this is relatively solvable if people in steering committees decided they cared. It's improving, but I'd argue not fast enough.
Comment by ctkhn 1 day ago
Comment by hoppp 1 day ago
Comment by td521534f12 1 day ago
Comment by eddythompson80 1 day ago
The chances of a person getting hit during the `npm install` phase is bigger but not that different than the `dotnet add package ... && dotnet run`.
I do agree though that the massive surface of npmjs, pip, and even cargo means that package signing is also not realistic. If you have the average 300 npm packages, no one is gonna pay attention to the authenticity of 200 different signing keys. It would be a lot easier with something like java where you probably just need to trust a handful like openjdk, jackson, junit, or log4j keys and be 90% there. (And hope the supply chain attack hasn't compromised the signing keys too of course)
Comment by td521534f12 1 day ago
Comment by eddythompson80 1 day ago
Comment by td521534f12 1 day ago
Comment by bigfatkitten 1 day ago
15 years ago you didn’t let your production infrastructure talk out to the Internet, and if you did, it was via an explicit proxy with allowlisted domains. This significantly limited the damage that a malicious dependency could cause.
With the move to cloud and DevOps, that network security model disappeared.
Comment by odo1242 1 day ago
Comment by bigfatkitten 1 day ago
Developers have decided that the convenience of just letting their servers pull arbitrary code off the Internet is more important than the security risks.
Comment by whoanoway 1 day ago
Comment by malfist 1 day ago
This is an attitude not reflective of reality for those that wrote code in the pre npm days
Comment by jbm 1 day ago
The fact is we always were dependent on others.
Comment by lincon127 1 day ago
Comment by animal_spirits 1 day ago
Comment by dpe82 1 day ago
Perl had CPAN already in 1993; Linux and common BSD distros have basically always had package repositories.
"People were responsible for the dependencies they were importing" - I don't know about that. Plenty of us were irresponsible 30 years ago.
Comment by freecodeio 1 day ago
The pre 2020 bootcampers would basically npm install anything because that's all they knew. You even had bullshit like "is-array" with millions of weekly installs because how dare you reinvent the wheel.
Comment by arctek 1 day ago
Comment by smashburger 1 day ago
I’m personally glad I don’t have to download separate runtimes and apps and can just use the standard browser
Comment by UltraSane 1 day ago
Comment by cyberclimb 1 day ago
Comment by palijer 1 day ago
Comment by antonvs 1 day ago
If you only ever run your banking app inside a VM with an encrypted disk volume, and don't browse sketchy sites or do anything else in there, then you're very well protected against even LLM-assisted attacks.
One caveat in that case is I wouldn't keep the password to the VM disk in a password manager, since that then becomes an attack vector.
A keylogger would still be a viable attack vector, though. The security of operating systems is going to need to be improved to guard against some of these things, e.g. a protected input mechanism for passwords that can't be intercepted.
Comment by giovannibonetti 1 day ago
The problem is that malware may sneak in, and then the user needs a horrible piece of software called anti-virus that needs to apply complicated heuristics to try and separate one from the other. It kind of worked ok for many years, but as the world evolved and the dangers kept increasing, little by little we have been going towards the other idea – default deny – where apps are considered harmful until proved otherwise, and the honest app developers have to jump through multiple hoops to get their apps available to users. That's the app store model, which kind of works, but is cumbersome and expensive for the app developer.
Anyway, going back to the VM discussion, I think we may end up applying the default deny idea further into the OS Kernel to reduce those risks further. After all, a small kernel has a much smaller risk surface and perhaps it can be formally verified to be secure under some reasonable assumptions.
Comment by antonvs 9 hours ago
Agents turn that assumption on its head. It's not only default allow vs. deny, but also the design of many tools. E.g. the Linux utility `ls` has an `-exec` option which can execute a binary, which turns a tool that really should be a read-only directory inspection tool into something that can execute arbitrary code. That makes it unsafe to authorize agents to always be able to use `ls`, unless they're running in a tightly controlled sandbox.
All OSes are full of these kinds of traps, because it wasn't something people were paying much attention previously.
Comment by rwmj 1 day ago
I wonder if/when mainstream OSes will start doing this.
Comment by BlobberSnobber 1 day ago
Comment by pull_my_finger 1 day ago
Comment by TuxSH 1 day ago
No need for something new here, Claude Code (Auto + default settings) has a tendency of running "find"/"ls" on your home folder when it struggles with solving a problem. I wish I was joking.
Now of course people trust these AI companies not to do bad things(tm), but all it takes is replacing the model endpoint URL -or any kind of harness compromise- and nothing will seem amiss
Comment by mystifyingpoi 1 day ago
I've seen this first-hand. I was doing some work in a repository, Claude concluded it needs to investigate, how some AWS resources are created, and it literally started scanning ~/* for Terraform code. Which it found and started browsing through.
Or, when I asked Claude to debug some Spring issue, corporate firewall blocked Maven Central, so it literally started scavenging ~/.m2 caches to find the jar it desperately needed. Then it could not find it, so it started to clone Spring sources from GitHub to build the missing jar. I stopped the clone mid-way. I wish I was joking, I only stepped away from the keyboard for one minute.
Comment by genxy 1 day ago
Comment by cluckindan 1 day ago
Comment by genxy 1 day ago
Comment by leafletsigh 1 day ago
I'd love to hear other takes on this though... Current thought is to just use something with a whole lot of exposure, in a whole lot of environments, pretty far downstream so the package hits all of that exposure, and hope someone spots it, kinda like xz. I tend to keep my base OS extremely minimal and do all my real work in VMs.
Comment by jgraettinger1 1 day ago
A recent example is the TCP options use-after-free, where it took Canonical a couple days to patch LTS beyond when the fix was first available in Fedora 45.
And these are just for public CVEs. I’m also worried that there are a lot of quiet fixes being made with new agentic review tooling, which may fix an undiscovered bug but will never be back-ported.
Comment by tavavex 1 day ago
I think the only way out is extreme scrutiny of all updates and paranoid minimization of all attack vectors, but the industry is only going to settle into that local minimum after we go through some devastating breaches.
Comment by leafletsigh 1 day ago
Comment by giovannibonetti 1 day ago
Comment by darkwi11ow 1 day ago
- development & AI tools
- infra rollouts
- banking / other sensitive services
I have Steam Deck for gaming, and do most of casual web browsing still on host, because it's secure enough to use Firefox with ublock + privacy badger and enforcing SELinux. However, I dont use socials other than HN and Reddit under pseudonymous accounts. If I had real zuckerbook or instacrap accounts, maybe I'd have another VM for socials too.
Comment by codedokode 1 day ago
I also use VM to run code editors and AI. One must be crazy to run third-party software (including package managers like npm) unrestricted. The overhead is significant, and VS Code UI is lagging heavily without a GPU.
Comment by Retr0id 1 day ago
Comment by darkwi11ow 1 day ago
Comment by revolvingthrow 1 day ago
The other SSD is a normal setup where you do normal computer stuff. I don't access the dev SSD through it, I don't even mount it, although the danger seems minimal if you do. Banking, socials, gaming, whatever. No AI of any kind on it, aside from web portal for claude/chatgpt/whatever and possibly local AI model that gets no internet access.
No idea why I'd want to have its own setup split between gaming and socials, as an example. Better yet just toss all your twitter and bluesky accounts into a volcano, and consider whether to do it with HN as well.
Comment by rainbowzootsuit 1 day ago
Comment by ffsm8 1 day ago
I feel like your phone is good enough for all of those, and generally secure enough unless you're rooting/jailbreak it
Comment by tetraodonpuffer 1 day ago
Gaming is a windows PC that has only games (so who cares) and a ps5 (so I can rent games at the library for free), development is a linux PC (where I containerize most things, as well as firejail etc.), web browsing is an x86 imac, I don't do socials, I also have a completely separate linux PC for art/drawing.
The vast majority of these has been bought for a couple hundred dollars 2nd hand from ebay or local university surplus (say they have all the time m1/16gb/500gb for $300-$400 imacs, or dell 16gb towers, or tons of dell laptops), the only expensive one was the linux development one as I bought a 5950x/128gb when it came out, but it has served me well, as long as you stay away from windows/mac you can go very far with really cheap hardware (DDR3 is plenty for banking / browsing / socials / factorio).
Comment by robswc 1 day ago
When I first started software, I thought it was the weirdest thing in the world for everyone to go "ok next step, download 1000 different pieces of code from 100 different places."
The only thing missing was the financial incentive, and ease of entry... and man if crypto + AI haven't got that combo down.
Comment by Aurornis 1 day ago
Popular harnesses have mature enough remote access features that I can use the same interfaces and even mobile apps.
If you’re not familiar with Docker, you can even have an LLM set up the environment for you and help you start and stop the container. If you do this, be very sure that you switch to having a harness run inside the VM or container, not having the harness on the host machine run commands inside the container. If you do the latter style, it will be running commands on the host which is what you want to avoid.
Comment by leptons 1 day ago
Comment by Aurornis 15 hours ago
I’m on Mac. Docker containers run inside a VM. I said that if you don’t have that situation you need to take that into account.
Docker can be escapable by a determined attacker, but the common compromises you see from packages or downloads aren’t doing complex container escapes. They smash and grab what they can. Docker does enough isolation that they don’t see what they’re after. It’s not as good as a VM, but better than nothing.
Comment by jonesy827 1 day ago
Comment by leptons 1 day ago
Comment by crossroadsguy 1 day ago
Comment by thenthenthen 1 day ago
Comment by tln 1 day ago
I already have users for Work stuff and Home stuff and Rando stuff. Fast user switching is great, however sometimes I need to do a quick check on some Home stuff, while seeing all my work windows.
Comment by kungp 1 day ago
Comment by duskdozer 1 day ago
Comment by narrator 1 day ago
Comment by JK-Swizzle 1 day ago
Comment by hoppp 1 day ago
No more laptops, just a dedicated android device.
I developed a devops/admin tool and then its claude code + github
Comment by heresie-dabord 1 day ago
This is a good, practical strategy. You definitely want to at least have a separate computer for finances and taxes.
Comment by bassie123 1 day ago
Comment by hangrybear666 1 day ago
Comment by hibikir 1 day ago
Comment by sick_of_slop 1 day ago
Comment by eastbound 1 day ago
- 1 computer and Google identity for administrative stuff: Primary accounts for AWS, Google. I also do accounting and have the list of customers. I still don't have any other solution than opening PDFs for the invoices, but it's better than nothing.
- 1 computer for programming, with a non-asministrator account for everything. Claude runs in Docker, with the dev directory mounted, .git:ro (read-only) and .env mounted to /dev/null.
But Claude tries to escape it A LOT. Claude is designed like a virus, we tell him not to do things, and it 1. tried to download the git binary from the internet, 2. read the remotes in the git directory and tried to access them, only blocked because it didn't have the credentials.
DEFINITELY forcefully block out Claude from seeing your .env files, it WILL try to brute-force an access to your intranet!!
Comment by Helmut10001 1 day ago
Comment by ProllyInfamous 19 hours ago
Only one machine is allowed to access google et. al. (my "slop bucket," which gets auto-imaged on every boot).
My tax iMac (2006) hasn't been online in two decades.
----
I've been playing with Docker (for the past month); the idea is cool, but a complete security nightmare; having read about the "guestWiFi hacks" across vlans, I think virtual machines aren't always a suitable solution (also read about two LLM-VMs communicating via CPU cahces – dam!).
–Tin F. Oil
Comment by crossroadsguy 12 hours ago
Comment by ProllyInfamous 8 hours ago
Am I misunderstanding some "deeper meaning" ?
Comment by Jtarii 1 day ago
Comment by cherrycherry98 1 day ago
Comment by bossyTeacher 1 day ago
Comment by mr_00ff00 1 day ago
Comment by steve1977 1 day ago
Comment by qaq 1 day ago
Comment by amelius 1 day ago
Comment by KronisLV 1 day ago
I mean if you have only one there’s https://www.qubes-os.org/ but not sure about the gaming part, nor is it necessarily as good as separate isolated hardware.
Architecture page: https://doc.qubes-os.org/en/r4.3/developer/system/architectu...
Comment by 0xbadcafebee 1 day ago
For your own user security, my suggestion is to stop using SaaS wherever you can. None of them are secure, and exfiltration is child's play. All SaaS I've worked for had terrible security.
Malware typically depends on two things:
1) Unpatched software. OS, apps, routers, etc. Always keep everything up to date on patches. 0-day exploits are rarely used because it burns a valuable resource. If you can use an OS that has very little malware (like Linux, MacOS) it reduces your risk. Malware also tends to lurk in certain spaces on the internet (porn sites, pirated media, shareware downloads, malicious ads), so staying clear of them also reduces your risk.
2) Persistent credentials. Most malware (at least when I was looking at it years ago) isn't very advanced/persistent. An advanced persistent threat may sit on your machine indefinitely until you login using credentials, but they may not use those credentials immediately. Sign in and out quickly (don't "stay signed in") and always use MFA, ideally a second device. Secured Android and iPhone devices are ideal for checking bank statements etc... but you must be vigilant not to install untrusted apps from App Stores (anything not from a major company), as they are more likely to infect you than your browser on normal/safe websites. If you can, try to use virtual credit card numbers, and use a credit rather than debit card for purchases.
Phishing largely depends on clicking a link in an email, but also SMS "alerts" and browser pages that look like OS pop-ups. To defend against these, use a password manager to generate random unique passwords everywhere, use MFA everywhere. For login, set up and use 1-click-login and passkeys, especially for the most important logins (bank, email). Don't share or reuse passwords or API keys for more than one thing; not only does it reduce the impact, but it helps you identify where the compromise came from.
I personally play "fast and loose" on my Linux desktop and don't run things in isolation. But if you want rock-solid security, the only real option is running applications in dedicated VMs, and only mounting files needed for that application. Don't depend on containers or sandboxes for security. If you want a "lightweight" alternative to VMs/containers, you can have multiple user accounts on your computer, lock each user account down (no reading/writing from other user accounts), and either login to different ones for different tasks, or run apps as that user and have them display in your current user's desktop.
Comment by Shank 1 day ago
Comment by realityfactchex 1 day ago
Comment by todowhatexactly 1 day ago
Comment by gambiting 1 day ago
Comment by Fricken 1 day ago
Comment by bluefirebrand 1 day ago
Comment by monlockandkey 1 day ago
Ideal setup:
- Dev machine
- Gaming machine (isolate downloading mods)
- Browsing machine
Comment by juleiie 1 day ago
For banking I use macOS/linux, sometimes iOS unfortunately but we all do sins
Comment by em3rgent0rdr 1 day ago
Comment by supertrope 1 day ago
Comment by lofaszvanitt 1 day ago
Comment by ant6n 1 day ago
You forgot one.
Comment by palata 1 day ago
Comment by TacticalCoder 1 day ago
I moved part of my wealth to a private bank, on an account requiring several signatures (from different persons) plus a vetting from the banker for every single outgoing transfer. Not only are several manual signatures required, in addition to that the banker must call me before authorizing any transfer, even if it's only, say, 1 000 EUR (now it's not a retail bank and that's kinda the whole point: transfers are rare and when one is done, no matter the amount, a shitload of verification do happen).
In addition to that, I told my banker that should anything out of the ordinary happen (say an order to suddenly wire 100 K to Dubai or Erithrea or something), then he should go out of his way to make me come in person to the bank to confirm the transfer.
You must train your banker: you must demo him voice impersonation on the phone. You have to make him become totally paranoid too.
I'm not going to say he's my buddy, but he knows I know my shit and we regularly talk for 20 minutes on the phone.
Any transfer to a new bank account: long discussion explaining what that account is and why I'm moving money there.
I've also got digital files (say administrative stuff, stuff from notaries, etc.), encrypted, that I myself cannot easily access. For to access them I must physically go to my safe at a bank first. And trying to impersonate me physically at the bank to steal my stuff means: "on your way out, you risk being locked in the secure airlock and then spend years behind bars".
> Makes me want to have like 5 separate computers:
I have a setup not totally unlike that. For example one phone with one additional app: the country's official "electronic ID" thinggy. And I don't browse from that phone.
I've got several computers and there's definitely my "trash computer", complete with bogus email accounts and crappy apps, etc.
> How else can you stay safe against a threat that exfiltrates your entire digital life in like 10 seconds?
The first thing is recognizing there's an issue if someone hacking your unique email then can steal everything you have. Many people stop there: they think, as in the XKCD, "it's game over anyway if someone gets my email, so I may as well not worry about it".
That is the mentality of losers.
You're already well ahead of the crowd by recognizing there's a problem and by thinking about solutions.
Many things can be done to lower the risk of a full compromise. I've got two physical LANs and the absolute most sensitive stuff (e.g. my banking apps) are done from a computer that does nothing but email + bank.
So it's not just a separate computer: separate computer on a separate physical LAN (not a VLAN). And there a tiny Pi doing the bridging between the two LANs. And of course it's got a serious firewall (a lost art, but it could make a comeback with the help of LLMs).
Something else that can help is stuff like Google Workspace and keeping the credentials for the admin account very secure and hardly ever logging into it. That way if "jack@acme.com" gets compromised, there's still "admin@acme.com" that can help get back control of jack@acme.com.
> - one for development only
I've got a user account for dev only.
> - one for gaming only
A dedicated computer for gaming yes.
> - one for socials only
Besides HN, I don't need those.
It's a wild world out there.
The hacks won't stop coming and you're not anywhere near paranoid enough.
Comment by vardalab 1 day ago
Comment by naillumanist 1 day ago
Comment by deeplower 1 day ago
Comment by sick_of_slop 1 day ago
Comment by nullsanity 1 day ago
Comment by Bluestein 1 day ago
Comment by pixl97 1 day ago
Comment by Bluestein 1 day ago
Comment by shaan7 1 day ago
Comment by Bluestein 1 day ago
... to us, wearng wearables of loving grace, that we do not own, but own us. All compute done beyond our reach, but ever-so-available, at the affordable price of a subscription and the prostitution of our soul.-
Comment by jumploops 1 day ago
Soon (now?) the threats will become ever more complex, and we’ll be back in the early-2000s-like virus storms.
Comment by deadnomore 1 day ago
Comment by caaqil 1 day ago
Script kiddies aren't new. Metasploit has been around literally decades. vx-underground existed for years, not to mention older open source projects that collect all known malware dev tools. APTs have been pwning stuff, script kiddies have been doing their thing. Nothing significant has changed for anyone in the know.
Just because LLMs automated some offensive stuff doesn't mean there's gonna be new magic collapse of society.
Comment by crtified 1 day ago
Comment by mullingitover 1 day ago
Comment by arm32 16 hours ago
Comment by steve1977 1 day ago
Comment by georgemcbay 1 day ago
Unfortunately LLMs still optimize scams/exploits to the point that they'll probably still get to those of us heading into the permanent underclass, just a little slower.
Comment by goatsi 1 day ago
Comment by riskable 1 day ago
Conversely, don't bother with poor people!
Now we just need proper Robin Hood malware that "levels out the playing field" as it were, by stealing from the rich and moving that money into the poor people's accounts (that have also been hacked).
Comment by yonatan8070 1 day ago
Comment by deadnomore 1 day ago
Comment by toomuchtodo 1 day ago
You’ll have created an autonomous Robin Hood clone army. Fun times.
Comment by hashmap 1 day ago
Comment by lowkey_ 1 day ago
Hackers are almost certainly using open-source AI for this.
Comment by vardalab 1 day ago
Comment by rustyhancock 1 day ago
Comment by milofeynman 1 day ago
Comment by yieldcrv 1 day ago
Comment by markstos 1 day ago
Comment by jruohonen 1 day ago
Comment by geekgod382 1 day ago
Comment by taytus 1 day ago
Comment by antonvs 1 day ago
This is an old idea just with AI added on top.
People even steal physical mail for this reason.
Comment by ransom1538 1 day ago
Phase 1: the closure, companies close down sites, all banks down
Phase 2: the reopen- but to only the correct* sites
Phase 3: the viruses
Phase 4: the re-shutdown
Phase 5: use of physical currency / fax machines only.
We are just getting to Phase 0. By end of 2026 most things will be broken into. By 2027 most banks will be offline.
Comment by bearjaws 1 day ago
Comment by prox 1 day ago
Comment by bearjaws 1 day ago
Recent example of a breach, they are now using AI to decomp APKs and iOS apps, mainly old builds of apps that nobody would bother spending the time on previously to look for secret keys or accidental information disclosure.
This would have been immensely time consuming with each app usually doing things a bit differently (e.g. encrypted + compiled settings, keys in database, settings in a settings.json).
Now you can automate the entire pipeline, this is actively being used to look for legacy API endpoints that may not be hardened or monitored, or if you don't rotate your keys and at one point disclosed them.
Comment by prox 1 day ago
Comment by ftchd 1 day ago
Comment by yieldcrv 1 day ago
Comment by usakyclite107 14 hours ago
Comment by MattSharples 1 day ago
Comment by READ_A_BOOK 1 day ago
Comment by 3seashells 1 day ago
Comment by thisisauserid 1 day ago
Comment by ctxc 1 day ago
Comment by thisisauserid 1 day ago
Comment by anigbrowl 1 day ago
Comment by ctxc 1 day ago
It's a good strat imo - start simple and get it working with LLMs asap, then you can add heuristics etc based on the data you have and improve with that benchmark
Comment by pixl97 1 day ago
Comment by thisisauserid 1 day ago