Multimodal Neurons in Artificial Neural Networks

Acknowledgments We are deeply grateful to Sandhini Agarwal, Daniela Amodei, Dario Amodei, Tom Brown, Jeff Clune, Steve Dowling, Gretchen Krueger, Brice Menard, Reiichiro Nakano, Aditya Ramesh, Pranav Shyam, Ilya Sutskever and Martin Wattenberg. Author Contributions Gabriel Goh: Research lead. Gabriel Goh first discovered multimodal neurons, sketched out the project direction and paper outline, and did […]

11 mins read

Bitcoin’s price spike supported by ETF demand as stablecoin buying power remains low

The exchange stablecoins ratio (ESR) and stablecoin supply ratio (SSR) provide important insight into Bitcoin’s liquidity and potential buying power. ESR measures the proportion of stablecoins relative to Bitcoin exchange reserves, serving as a gauge of spot liquidity. A low ESR reflects limited immediate buying power, while a high ESR points to abundant capital waiting […]

3 mins read

Bitcoin mining pushes sustainability agenda with over 50% of energy generated from renewables

Sustainable energy accounts for more than half of Bitcoin (BTC) mining consumption as of the first quarter, according to the Cambridge Centre for Alternative Finance’s Digital Mining Industry Report.  Despite higher energy consumption, the industry’s reliance on sustainable energy increased, and operational metrics indicated a push toward long-term resilience through diversification and innovation. Estimated annual […]

3 mins read

Banking on innovation: Engineering excellence in regulated financial services

Today’s financial services engineer has two needs. One is cutting-edge tech and frictionless access, and the other is robust security and risk management. Balancing both is tricky. “We might be a highly regulated, centuries-old bank, but when engineers join us, their expectations are cutting-edge tech and fast access to data, with a self-serve process,” explains […]

7 mins read

Branch Specialization

This article is part of the Circuits thread, an experimental format collecting invited short articles and critical commentary delving into the inner workings of neural networks. Visualizing Weights Weight Banding Introduction If we think of interpretability as a kind of “anatomy of neural networks,” most of the circuits thread has involved studying tiny little veins […]

21 mins read

Justin Sun calls JST a ‘next 100x token’ amid growth of TRON’s DeFi ecosystem

TRON founder and prominent crypto industry figure Justin Sun has taken to the social media platform X to make optimistic claims about the future of JST (JUST), the governance token of the Just ecosystem. In a recent post, Sun declared that JST has undergone a “complete fundamental reversal,” and suggested it could become the “next […]

2 mins read

How should Stripe deprecate APIs? (~2016)

While Stripe is a widely admired company for things like its creation of the Sorbet typer project, I personally think that Stripe’s most interesting strategy work is also among its most subtle: its willingness to significantly prioritize API stability. This strategy is almost invisible externally. Internally, discussions around it were frequent and detailed, but mostly […]

6 mins read