少点错误 09月06日
AI安全训练营:招募项目负责人,共塑安全AI未来
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

AI Safety Camp是一个为期三个月的在线研究项目,旨在汇聚有AI安全研究想法的个人,组建团队共同推进项目。项目面向有研究经验和领导潜力的个人,邀请他们提出AI安全研究课题,并担任项目负责人,指导团队完成研究。项目涵盖AI对齐、AI发展暂停等多个方向,鼓励创新性思维。申请者需具备一定的研究或领导经验,并承诺每周投入至少10小时参与项目。项目提供支持以完善研究计划,并帮助招募团队成员。整个项目周期从2026年1月至4月,包含开营、研究阶段及最终成果展示。

💡 **AI安全研究合作平台**:AI Safety Camp提供了一个为期三个月的在线研究平台,旨在连接有AI安全研究想法的个人,帮助他们组建团队,共同致力于AI安全领域的项目研究。项目鼓励参与者提出自己感兴趣的研究方向,并为AI安全的发展贡献力量。

🚀 **项目负责人招募与支持**:该项目特别招募“项目负责人”(Project Lead),邀请有研究经验和领导能力者提出AI安全研究课题。一旦被接受,组织者将协助项目负责人完善其研究计划,并帮助其招募和选择团队成员,确保项目能够顺利进行。

🗓️ **详细时间线与参与要求**:项目将于2026年1月至4月在线进行。项目负责人申请截止日期为9月28日,最终研究计划截止日期为10月19日。团队成员申请将于10月25日开放至11月16日。项目要求项目负责人每周投入至少10小时,并具备一定的领导或研究经验,如博士一年级以上、完成过相关AI安全训练营或有研究实习经历。

🎯 **研究方向与目标**:AI Safety Camp鼓励广泛的研究课题,包括但不限于AI对齐、AI发展减缓或暂停、去混淆研究等,核心目标是确保未来AI的安全性。项目强调理论可行性(Theory of Change)和实际可操作性(Project Plan),并会评估潜在的下行风险(Downside Risk),以避免项目可能加速AI能力发展。

💰 **津贴与长期合作**:目前项目不提供津贴,但若有资金,将优先考虑低收入国家参与者。项目鼓励团队在官方结束后继续合作,但建议初期不要做出超越项目官方长度的承诺。

Published on September 6, 2025 1:17 PM GMT

Do you have AI Safety research ideas that you would like to work on with others? Is there a project you want to do and you want help finding a team? AI Safety Camp could be the solution for you!

Summary

AI Safety Camp Virtual is a 3-month long online research program from January to April 2026, where participants form teams to work on pre-selected projects. We want you to suggest the projects!

If you have an AI Safety project idea and some research experience, apply to be a Project Lead. If accepted, we offer some assistance to develop your idea into a plan suitable for AI Safety Camp. When project plans are ready, we open up team member applications. You get to review applications for your team, and select who joins as a team member. From there, it’s your job to guide work on your project.

Who is qualified?
We require that you have some previous leadership or research experience. If you are at least 1 year into a PhD or if you have completed an AI Safety research program (such as a previous AI Safety Camp, PIBBSSMATS, and similar), or done a research internship with an AI Safety org, then you are qualified already. Other experience can count, too.

More senior researchers or project leads are of course also welcome, as long as you think our format of leading an online team inquiring into your research questions suits you and your project.

We require that all Project Leads are active participants in their projects and spend at least 10h/week on AISC for the duration of the program.

 

Apply here

 

If you are unsure, or have any questions you are welcome to:

 

Choosing project idea(s)

AI Safety Camp is about ensuring future AIs are either reasonably safe or not built at all.

We welcome many types of projects including projects aimed at stopping or pausing AI development, aligning AI, deconfusion research, or anything else you think will help make the world safer from AI. If you like, you can read more of our perspectives on AI safety, or look at past projects.

If you already have an idea for what project you would like to lead, that’s great. Apply with that one!

However, you don’t need to come up with an original idea. What matters is you understanding the idea you want to work on, and why. If you base your proposal on someone else's idea, make sure to cite them. 

You can submit up to two project proposals if you want. However, you are only allowed to lead one project.

Use this template to describe your project proposal.

 

We’ll help you improve your project

As part of the Project Lead application process, we’ll help you improve your project. The organiser whose ideas match best with yours, will work with you to create the best version of your project.

We will also ask for assistance from previous Project Leads, and up to a handful of other trusted people, to give you additional feedback.

 

Timeline

Project Lead applications

Team member applications:

Program 

Afterwards

 

Application process for Project Leads

As part of the Project Lead application process we will help you improve your project plan, mainly through comments on your document. How much support we can provide depends on the number of applications we get. However, everyone who applies on time (before September 28th) is guaranteed at least one 1-on-1 call with someone on the AISC team, to discuss your proposal. 

Your application will not be judged based on your initial proposal, but on the refined proposal, after you had the opportunity to respond to our feedback. The final deadline for improving your proposal is October 19th. 

Your Project Lead application will be judged based on:

    Theory of change
    What is the theory of impact of your project? Here we are asking about the relevance of your project work for AI Safety. If your project succeeds, can you tell us how this makes the world safer?Project plan and fit for AISC
    Do you have a well-thought-out plan for your project? How well does your plan fit the format of AISC? Is the project something that can be done by a remote team over 3 months? If your project is very ambitious, maybe you want to pick out a smaller sub-goal as the aim of AISC?Downside risk
    What are the downside risks of your projects and what is your plan to mitigate any such risk? The most common risk for AI safety projects is that your project might accelerate AI capabilities. If we think your project will enhance capabilities more than safety, we will not accept it.You as Project Lead
    Do we believe that you have the required skills and commitment to the project, and enough time to spend on this, in order to follow through? If we are going to promote your project and help you recruit a team to join you, we need to know that you will not let your team down. 

 

Apply here

 

Stipends

As of now, we do not have any funds available for stipends. In case of a stipend grant around beginning October, we would still only be able to offer stipends for participants residing in low-income countries.

 

Do you want to be a Project Lead?

If you have a project idea and you are willing to lead or guide a team working on this idea, you should apply to be a Project Lead.

We don’t expect a fully formed research plan! If we think your idea is suitable for AISC, we can help you to improve it.

If you are unsure, or have any further questions you are welcome to:

Apply here



Discuss

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

AI Safety Camp AI安全 人工智能 研究项目 项目负责人 AI Alignment AI Safety Research Artificial Intelligence Research Program Project Lead
相关文章