Researcher, Misalignment Research
- Worst-Case Demonstrations - Craft compelling, reality-anchored demos that reveal how AI systems can go wrong. We focus especially on high importance cases where misaligned AGI could pursue goals at odds with human well being.
- Adversarial & Frontier Safety Evaluations - Transform those demos into rigorous, repeatable evaluations that measure dangerous capabilities and residual risks. Topics of interest include deceptive behavior, scheming, reward hacking, deception in reasoning, and power-seeking, along with other related areas.
- System-Level Stress Testing - Build automated infrastructure to probe entire product stacks, assessing end-to-end robustness under extreme conditions. We treat misalignment as an evolving adversary, escalating tests until we find breaking points even as systems continue to improve.
- Alignment Stress-Testing Research - Investigate why mitigations break, publishing insights that shape strategy and next-generation safeguards. We collaborate with other labs when useful and actively share misalignment findings to accelerate collective progress.
- Design and implement worst-case demonstrations that make AGI alignment risks concrete for stakeholders, focused on high stakes use cases described above.
- Develop adversarial and system-level evaluations grounded in those demonstrations, driving adoption across OpenAI.
- Create automated tools and infrastructure to scale automated red-teaming and stress testing.
- Conduct research on failure modes of alignment techniques and propose improvements.
- Publish influential internal or external papers that shift safety strategy or industry practice. We aim to concretely reduce existential AI risk.
- Partner with engineering, research, policy, and legal teams to integrate findings into product safeguards and governance processes.
- Mentor engineers and researchers, fostering a culture of rigorous, impact-oriented safety work.
- Already are thinking about these problems night and day, and share our mission to build safe, universally beneficial AGI and align with the OpenAI Charter.
- Have 4+ years of experience in AI red-teaming, security research, adversarial ML, or related safety fields.
- Possess a strong research track record-publications, open-source projects, or high-impact internal work-demonstrating creativity in uncovering and exploiting system weaknesses.
- Are fluent in modern ML / AI techniques and comfortable hacking on large-scale codebases and evaluation infrastructure.
- Communicate clearly with both technical and non-technical audiences, translating complex findings into actionable recommendations.
- Enjoy collaboration and can drive cross-functional projects that span research, engineering, and policy.
- Hold a Ph.D., master's degree, or equivalent experience in computer science, machine learning, security, or a related discipline (nice to have but not required).
- A chance to shape safety practices at the frontier of AGI. Your work will directly lower the changes of catastrophic misalignment.
- Access to cutting-edge models, tooling, and compute resources.
- A highly collaborative, mission-driven environment with world-class colleagues.
- Competitive compensation, equity, and benefits.
Recommended Jobs
Project Wastewater Engineer
A multi-discipline consulting firm is seeking a Project Wastewater Engineer for their growing team in Huntington, New York! Responsibilities: Perform various engineering tasks including was…
Assistant Professor - 12 Month, Biostatistics
The Department of Biostatistics , the only statistics department in University at Buffalo – The State University of New York seeks applicants for multiple Tenure-Track Assistant Professor pos…
Investigator, Parole Revocation Defense Unit (PRDU) The Legal Aid Society Justice in Every Borough
The Legal Aid Society’s Parole Revocation Defense Unit (PRDU) has openings in the Bronx and Brooklyn Trial Offices for a skilled Investigator to work closely as a member of the PRDU Team which includ…
Procurement Lead
Job Description Why join us? It's an exciting time at AtkinsRéalis! We are rapidly growing in the US. Our company purpose is to build a better world for our planet and its people. We recognize …
Mid-Market Account Director - Higher Education, Academic, Talent Solutions
LinkedIn is the world's largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exci…
Veterinary Criticalist (Board Certified / Diplomate / Residency Trained) J664724
**Unlock Your Potential with a Thriving Veterinary Career – Earn up to $260,000** The Hospital Join a state-of-the-art animal hospital that is leading the pack in veterinary care. This AAHA-acc…
Director of Sales
About Us: Air Innovations is a world leader in designing and building environmental process control systems for applications that can’t be addressed with standard HVAC equipment. We customize pack…
Python Developer
Position: Python Developer Location: Fort Mill, SC/ NYC, NY Duration: Full-Time ROLE SUMMARY Seeking a Senior Python Backend API Engineer with deep hands-on experience building and opera…
Pediatrician
Pediatrician / Bilingual Spanish - Bronx, NY (#1606) Medical, Dental, and Vision insurance Flexible Spending Account Paid Time Off Retirement Savings Commuter Benefits progra…
Sous Chef
COTE, the carnivorous vision of proprietor Simon Kim, blends the dining experience of Korean Barbeque together with the hallmarks of a classic American Steakhouse. The result is a unique, convivial a…