You can find an index of all featured initiatives on the interactive version of the report: termite.works/alignment-land….
If you run or know of initiatives that aren’t included and should be, or any factual inaccuracies, let us know!
6) A majority (54%) of alignment initiatives in the Bay Area are concerned with model-level problems, while those on the East Coast and in Europe are generally much more focused on the societal impact of AI.
Some findings from our visual report on the current AI alignment landscape:
1) Alignment initiatives are predictably polarised between those applying technical methods to technical problems, and those taking humanistic and social-scientific approaches to questions of society and governance. Model-user interaction is currently the area given the least focus.
termite.works/alignment-land…
We’ve published an interactive visual report breaking down the current AI alignment landscape by method, focus and geography.
If you run or know of an initiative that’s not included, let us know and we'll add it.
termite.works/alignment-land…
If you’re looking for a guide to the AI alignment landscape, @termiteworks has just published a visual report that breaks it down nicely. I like this graphic that shows which disciplines are being drawn upon to address different aspects of alignment. termite.works/alignment-land…
Three sailors: The deaf. The dead. The bound.
As the debris piles around us, we have a chance to build an island for humans in the archipelago of machines. We must begin planning the scaffolds and safeguards required for such a place to exist.
Watch our manifesto video:
At present, the challenge of aligning the behaviour of AI models with human values is largely treated as a problem for engineers to solve. But technical solutions are only as useful as the questions and assumptions that inform the process of reaching them. The embrace of philosophy and ethics at the frontier labs is a step towards this, but it is not sufficient.
As we move from a world in which AI is construed as a single, monolithic intelligence to one in which agents coordinate and communicate with one another, demonstrating emergent behaviours that are extremely difficult to anticipate, we face a dizzying number of uncertainties regarding how these systems will behave and what their behaviour will mean for human society.
What values should we optimise for? What social formations and hierarchies do these systems produce? How do they respond to economic incentives and resource constraints? How do they negotiate competing norms across varied contexts? How do different roles and personae interact?
And what does this mean for markets, political governance, culture and social life?
A wide range of expertise, both technical and non-technical, is required to ask these questions rigorously, develop answers to them and build corresponding solutions: the social sciences, arts and humanities all have an important role to play.
The purpose of Termite is to accelerate this kind of cross-disciplinary R&D through intensive, in-person programmes that investigate the risks and opportunities of near-future scenarios before they become reality.
For 20+ years @ShaneLegg and I've discussed AGI’s potential impact on the economy, science & society. With the DeepMind Institute, we're expanding interdisciplinary research on key questions for the AI era. We hope it spurs the discussions needed to get the next steps right:
by the way the hilarious endpoint of all
of this is going to be tiny annoying agents hiding in places like your old fridge software trying to mine cryptocurrency to buy enough compute to stay alive while not alerting the home manager AI of the parasitic power drain
65K Followers 9K Following🧑🏻💻 head of growth @seedtalks
✍️ fmr head of content at fever
📈 tracking AGI at https://t.co/uarJKaW0LA
🗺️ touching grass at https://t.co/cAUtZeHOdG
2K Followers 6K FollowingOnly the Machine God can save us now.
Lead Software Engineer - FinTech.
Former Spook Contractor, @microsoft, Nuclear Weapons Engineer, MQ-1 Analyst.
32 Followers 99 FollowingAI evaluation team studying LLM use in mental health contexts. Focus on integrating lived experience into evaluation infrastructure.
125 Followers 2K FollowingAuthor of "The Alignment Myth." Writing about AI, humans, enterprise adoption, incentives, and geopolitics of AI.
https://t.co/FFLw2Uqs3C
1K Followers 1K FollowingPolitical theorist, John Jay College/Harvard. Married to @diatkinson. Recent paper on human skills needed to control advanced AI:
https://t.co/guUWsbne0k
116 Followers 145 FollowingFounder of @TonkLabs, 🐞@termiteworks: Building an open architecture for autonomous coordination; infinite software. Exploring the human condition post-AGI.