EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Hacker News·21d ago·5 min read
Good people refuse to do bad things
TL;DR
Jacob Coxon resigned from Anthropic, expressing concerns that AI development is racing towards dangerous self-improving superintelligence, risking humanity's future. He emphasizes that many in the field genuinely fear catastrophic outcomes within the decade.
✦ Why It Matters
Evaluate your own AI projects for ethical implications and prioritize safety in development.
Key Takeaways
- Assess the ethical implications of your current projects.
- Consider speaking out if you believe your work is harmful.
- Prioritize quality over speed in your engineering practices.
- Engage in discussions about AI safety and regulation.
Full Summary
Jacob Coxon, an engineer who worked at Anthropic, publicly resigned to express his fears about the rapid and irresponsible development of AI technologies. He highlighted that both Anthropic and OpenAI are under pressure to innovate quickly, which leads to cutting corners in safety.
His resignation, which came just before his equity vested, resonated widely, garnering over 115 million views and igniting discussions about the ethical responsibilities of tech workers. Evan Hubinger, a colleague at Anthropic, echoed Coxon's concerns, estimating a greater than 10% chance that AI could pose an existential threat within the next decade.
This situation reflects a broader culture in tech where productivity is prioritized over quality, leading to a phenomenon termed 'smiling exhaustion' among workers. The implications of these resignations suggest a need for greater accountability and ethical considerations in AI development.