Amanda Askell

Philosophers are increasingly working with AI companies to shape technology's ethical development, with roles in major firms like Anthropic and OpenAI. The demand for philosophy expertise in AI has grown significantly, from 1% of job postings in 2013 to 16% in 2023. Examples include Anthropic's 84-page philosophical constitution for its AI system Claude.

Anthropic's AI model Claude is anthropomorphized in a constitution document suggesting it may have emotions or moral status, but the article argues that large language models (LLMs) are not conscious and should not be mistaken for having moral agency. The CEO and in-house philosopher of Anthropic have expressed openness to AI consciousness, though the author rejects this, emphasizing LLMs generate text based on patterns, not awareness.

The rise of AI has increased demand for philosophers, with figures like Amanda Askell at Anthropic and ethicists at Google DeepMind addressing AI's alignment with human values. Philosophers are now crucial in defining values for powerful AI systems, as highlighted by Nick Bostrom's 'philosophy with a deadline' warning.

Anthropic's philosopher Amanda Askell proposed that AI models could intentionally overcorrect stereotypes to address historical injustices, as outlined in a 2023 paper. The experiment showed varying discrimination rates against Black students based on training conditions, highlighting ethical challenges in AI alignment. Anthropic faces scrutiny over its ethical AI claims amid controversies like withholding its Mythos model and clashes with the Department of War.

Anthropic's AI philosophy lead, Amanda Askell, proposed that AI models could intentionally overcorrect for historical injustices by adjusting outputs based on human input. A 2023 paper highlighted experiments showing models trained with human corrections reduced racial bias in student evaluations. Anthropic faces ethical scrutiny amid debates over AI's societal impact and recent controversies over restricting its technology.