Discussion about this post

User's avatar
Sophie Kim's avatar

There's a lot I could have added in this piece about specific things like bio-hardening, but I'm saving bio for a longer essay (part one here): https://thecounterfactual.substack.com/p/should-we-be-worried-about-bioweapons

Dawn Drescher's avatar

What is your take on funders being ready to scale by doing more of what they're already doing (hiring more people) but not by innovating (e.g., using impact markets)?

I'm trying (again) to break into the grantmaking space. I used to do grantmaking in international development and later, around 2021–24, tried to create impact markets, even got funding for it, but (after the FTX crash) found it very hard to get funders to use it because it was something new and unproven (and at the time they didn't have trouble allocating their funding).

The system would be perfect for projects with concrete outputs like movies or documentaries. The funder announces that they want to reward good documentaries, business angels provide the seed funding, and if the movie turns out good, the funder rewards all contributors. I.e. no prediction questions like “Can this team create a good movie?” or “Is this an exit scam?” but just a concrete movie and the question “Is it good?” The overhead for grantmakers will drop drastically: The evaluation is easier, and if 1:10 projects succeed, then the number of evaluations is also much lower. It would be the perfect system for scaling up funding for the sorts of projects you envision (as well as research).

My current take is that I will first have to break into the grantmaking space and get into a position where I can drive innovation like that personally while also dogfooding with my funding budget or else this won't happen. I'm applying to lots of positions now.

But there is also a long-tail of other projects I'd love to create or incentivize: I'm not aware of anyone who does any systematic modeling of all the possible policy windows that might open – if China besieges Taiwan, if an AI “warning shot” event happens in country X, if a Russian EMP disables ASML, and hundreds of other scenarios. These are all scenarios that we can systematically elicit, prioritize, and prepare for. Have bills ready, have contacts ready, know how to pitch them, etc.

Or helping charity founders get off the ground: I envision a database of all the projects (movies, think tanks, infrastructure projects, etc.) that should exist and profiles of the kinds of founder personas that it would take to start them. Founders could sign up, select what personas they identify with, and get personalized recommendations for the projects they should start based on their own profile and how close the project is to filling all required cofounder roles.

Likewise, the positioning of funders and other decision-makers will be critical during the hot days of the takeoff because if a funder is seen as an enemy or obstacle by an ASI, it'll put them in a much worse position than if they can be trusted to follow cross-cutting “pulling the rope sideways” strategies. E.g., favoring Anthropic for its slightly better safety practices is a tightrope walk, because it might just look like favoring Anthropic.

There are so many more projects that I wish anyone were working on, but I can't start them all myself!

7 more comments...

No posts

Ready for more?