Back

autonomous coding + long-term coherence

1 min readZi Wang

Z / Runner ๐Ÿƒ๐Ÿปโ€โ™‚๏ธ

๐Ÿƒ๐Ÿปโ€โ™‚๏ธ Scaling long-running autonomous coding: Running for weeks To test this system, we pointed it at an ambitious goal: building a web browser from scratch. The agents ran for close to a week, writing over 1 million lines of code across 1,000 files. You can explore the source code on GitHub.

๐Ÿƒ๐Ÿปโ€โ™‚๏ธ implementing AlphaGo from scratch (repo will be open sourced soon) to catch up on foundational deep learning techniques, and also to re-learn how to program with the full power of modern coding agents.

  • >/experiment Apply maximal update parameterization to find the best hyperparameters as I scale up. Start with GoResNet-100M as base. Use d-muP for depth-wise stability. Train 1 epoch on dev-train-100k. Submit up to 4 parallel Ray jobs.
  • >/experiment Study scaling laws. Propose 5 model sizes from 1M to 1B params. Train each on dev-train-100k with bfloat16. Fit power law L(C) = a*C^b. Generate Chinchilla-style compute-optimal plots.
  • >/experiment Play the NN checkpoint against gnugo10. Max 81 moves per game. Evaluate 20 games. Visualize the policy softmax heatmap on each board state.
  • >Implement MCTS in src/alpha_go/mcts.py using AlphaGo paper nomenclature. Node with N (visit count), Q (value), logP (log-probs). Add PUCT selection, expansion, backpropagation. Test with toy environment.

๐Ÿƒ๐Ÿปโ€โ™‚๏ธ "Coding assistants will soon become so good that they can conjure any digital system in an effortless way, like having a wish-granting genie for the price of $20 a month. Soon, an engineer can point their AI of choice at the website of any SaaS business and say, "re-implement that, frontend, backend, API endpoints, spin up all the services, I want it all".

Stephen / Basketball ๐Ÿ€

๐Ÿ€ Claude Opus 4.6 performs on a variety of benchmarks that assess its software engineering skills, multilingual coding ability, long-term coherence, cybersecurity capabilities, and its life sciences knowledge.

Select any passage to copy a prompt ยท esc to return