Ask HN: Is anyone giving out tokens for benchmarking LLMs?

Posted by emosenkis 10 hours ago

Counter3Comment1OpenOriginal

I'm thinking of benchmarking different models performance playing Nethack and learning the game under different constraints.

Comments

Comment by codersfocus 10 hours ago

LMarena, now https://arena.ai. Not sure if they have API access to automate it though.