AI Safety Incubation Program
This information is about our current program. We are no longer accepting applications, and this information is only for reference.
The program is designed to bring together founders, advisors, and funders to enable them to advance the AI safety field together. Our program is open to incubating both non-profit and for-profit companies.
Express your interest in participating in a future iteration of our program below.
Why This Program?
We are at a critical juncture in AI development. A recent survey of 2,778 AI researchers revealed that nearly half estimate at least a 10% chance of advanced AI leading to catastrophic outcomes, including human extinction [1]. Despite this, only 1-3% of AI publications focus on safety [2]. The world urgently needs more dedicated AI safety research to address these existential risks and shape the future of AI responsibly.
Our program is your starting point to make a positive impact in the AI Safety field. We facilitate:
-
Finding a co-founder: Thoroughly test your co-founding fit with others who complement your skills and share your values.
-
Mentor & advisors: Access support from the Catalyze Impact team and external industry experts & experienced entrepreneurs.
-
Funding opportunities: Connect with our non-profit seed funding circle and potential investors, while being supported by a requestable stipend during the program.
-
Network & community: Immerse yourself in a group of fellow AI safety founders and grow your network in the London AI safety ecosystem.
-
Build up your organization: Work on the priorities within your up-and-coming organization, while making use of external support whenever you want to.
Whether you're starting from scratch or already have a co-founder and initial concept, our program is designed to help you quickly move forward. We focus on equipping you with the skills, funding and network to truly make a difference in AI safety. We are a non-profit focused on advancing the AI Safety field and our mission is to make you succeed by incubating and accelerating your idea. Catalyze will not take a stake in any incubated company, whether for-profit, or non-profit. Your organization will be entirely under your control.
You will receive tailored support from the Catalyze Impact team and from external experts, such as:
Program Overview
This program is a pilot and consists of two phases. If you already have a co-founder and organization idea, you can join us for Phase 2 without joining Phase 1. If so, you will have the opportunity to indicate this in your application.
Phase 1: Co-founder Matching
Location: Online. Time commitment: 12-20 hours a week for 5 weeks between 4 November and 8 December. During the initial online program, you will be part of a cohort of around 15 individuals committed to improving AI Safety, which will help you expand your network of AI Safety professionals. Participants will 1. Define their ideal co-founder profile. 2. Collaborate in rotating pairs on a variety of useful projects to test co-founder fit with the other participants. 3. Further develop their research organization proposals. Participants have a strong say in who they test their fit with and will decide themselves who they want to co-found with.
Towards the end of Phase 1 you will evaluate whether you want to commit to moving to Phase 2 with the co-founder you found, and we will assess whether you and your co-founder are a good fit for Phase 2. Advancing to Phase 2 is primarily based on forming a promising founding team during Phase 1. While having a well-developed organization concept is beneficial, we value teams that are open to refining or pivoting their ideas.
After Phase 1, there will be a four-week break during which you will prepare for Phase 2 by further developing your organization plan with your identified co-founder and arrange to join us full-time in-person in London for Phase 2.
Phase 2: In-Residence Organization Building
Location: London. Time commitment: full-time for 4 weeks between 6 January and 2 February. For exceptional candidates we may allow part-time participation instead.
You and your co-founder(s) will work together in-person to focus on the very early stages of building your organization. While you focus on taking the next steps in building your organization, preparing to fundraise, and further stress-testing your co-founding fit, we provide various forms of support, such as: 1. Bookable office hours with a network of experienced mentors and advisors. 2. A requestable stipend of up to two months to enable you to work on your organization full-time. 3. A community of fellow AI Safety research organization founders and organized networking opportunities in the wider London AI Safety ecosystem. 4. Tailored support from the Catalyze Impact team, such as resources, connections, and coaching. 5. Access to a non-profit seed funding circle that you can apply to at the end of the program and introductions to potential investors.
Post-Program
After the program, we will provide continued individualized support for our graduates and continued access to the Catalyze community.
Who Are We Looking For
You would be a great fit for the program if:
-
You are highly-committed, a self-starter, and have a lot of grit. Starting an organization is difficult, but it can have an incredible impact.
-
You are motivated to contribute to AI Safety. You aspire to create meaningful, positive impact in the field and believe that it is a priority to prevent severely negative outcomes from AI.
-
You have a scout mindset. You are open to alternative views, have an inclination to explore new information and arguments, and consider these critically to alter your course when new information is available.
-
You either have a preliminary plan or agenda for an AI Safety research organization, or are willing to collaborate with someone who does. You will be able to develop this further during the program.
Additionally, you fit one of the following three profiles:
1. Technical Profile
Technical research or engineering experience, combined with a good understanding of AI Safety (e.g. you have worked as a researcher within AI Safety or a closely related field, completed MATS, and/or conducted several research projects within AI).
2. Operational/Entrepreneurial Generalist
You have an operational and/or entrepreneurial skill set, such as experience with project management, managing finances, legal matters, HR, setting up systems and processes. You may have founded organizations in the past, and you have a reasonable understanding of AI Safety, equivalent to completing BlueDot’s Safety Fundamentals Alignment or Governance track.
3. All-Rounder
You have a mix of the technical and operational skills in the other profiles and at least a reasonable understanding of AI Safety.
During the program we will facilitate creating founding teams that possess strong entrepreneurial know-how and technical knowledge. If you are not sure whether you meet all of these characteristics, please apply anyway. The application process is designed to help both you and us gain more clarity on your fit for co-founding an AI Safety research organization.
Commitment to diversity and equal opportunities
Catalyze Impact is an equal opportunity organization. We are committed to inclusion and encourage individuals with diverse backgrounds and experiences to apply. We especially encourage applications from people of color, women, non-binary, disabled, and neurodivergent individuals who are excited to contribute to AI Safety. Our application process is blinded wherever possible to reduce bias. If you need assistance or accommodations due to a disability, or have any other related questions about applying, please contact us at info@catalyze-impact.org.
Application Process
The application process consists of four steps. The process is designed to help you figure out if you would be a good fit for starting a new organization, so do not hesitate to apply if you are unsure.
-
Written application: Questionnaire and CV upload (30-45 minutes).
-
Test task: Demonstrate your skills and thinking (~3-4 hours).
-
Interview: In-depth discussion about your background and goals (~45 minutes).
-
Reference checks: We will contact up to two of your references.
We are no longer accepting applications for this round of the program. If you are interested in taking prat in a future iteration, please express your interest below or sign up for our newsletter.
Application Tips
-
Highlight your individual contributions when describing past projects. Be specific about your role and impact.
-
For any links in your application:
-
Ensure they are publicly accessible. Test them in an Incognito or Private Browsing window.
-
Provide a brief summary of key points or takeaways from linked content.
-
-
Before submitting:
-
Review your answers to ensure they directly address each question.
-
Double-check all contact information, particularly your email address, for accuracy.
-
FAQ
Is this program suitable if I'm new to AI Safety?
While we assume a basic understanding of AI Safety, equivalent to completing an introductory course such as BlueDot’s AI Safety Fundamentals, we encourage you to apply if you are passionate and willing to learn quickly. You can access AI Safety Fundamentals course materials and work through them in your own time. Additionally, you can find more resources to get started with AI Safety here and here. Please check the “Who Are We Looking For” section for more details.
Do I need an organization idea to apply?
Can I apply together with my co-founder?
What kinds of organizations does Catalyze incubate through this program?
What if I do not find a good match with a co-founder or organization idea in phase 1?
How could I notice that this is a pilot program?
Will Catalyze take a stake in incubated for-profit companies?
Why choose Catalyze's incubation program over going solo?
What financial support is available throughout the program?
Who is eligible to apply?
I have more questions. Who can I contact?