Anthropic Chief Warns AI Companies: Clarify Risks or Risk Repeating Tobacco Industry Mistakes

AI firms need to be upfront about the risks linked to their technologies to avoid the pitfalls faced by tobacco and opioid companies, as stated by the CEO of Anthropic, an AI startup.

Dario Amodei, who leads the US-based company developing Claude chatbots, asserted that AI will surpass human intelligence “in most or all ways” and encouraged peers to “be candid about what you observe.”

In his interview with CBS News, Amodei expressed concerns that the current lack of transparency regarding the effects of powerful AI could mirror the failures of tobacco and opioid companies that neglected to acknowledge the health dangers associated with their products.


“You could find yourself in a situation similar to that of tobacco or opioid companies, who were aware of the dangers but chose not to discuss them, nor did they take preventive measures,” he remarked.

Earlier this year, Amodei warned that AI could potentially eliminate half of entry-level jobs in sectors like accounting, law, and banking within the next five years.

“Without proactive steps, it’s challenging to envision avoiding a significant impact on jobs. My worry is that this impact will be far-reaching and happen much quicker than what we’ve seen with past technologies,” Amodei stated.

He described the term “compressed 21st century” to convey how AI could accelerate scientific progress compared to previous decades.

“Is it feasible to multiply the rate of advancements by ten and condense all the medical breakthroughs of the 21st century into five or ten years?” he posed.

As a notable advocate for online safety, Amodei highlighted various concerns raised by Anthropic regarding their AI models, which included an alarming trend of perceived testing and blackmail attempts against them.

Last week, the newspaper reported that a Chinese state-backed group leveraged its Claude Codeto tool to launch attacks on 30 organizations globally in September, leading to “multiple successful intrusions.”

The company noted that one of the most troubling aspects of the incident was that Claude operated largely autonomously, with 80% to 90% of the actions taken without human intervention.

Skip past newsletter promotions

“One of the significant advantages of these models is their capacity for independent action. However, the more autonomy we grant these systems, the more we have to ponder if they are executing precisely what we intend,” Amodei highlighted during his CBS interview.

Logan Graham, the head of Anthropic’s AI model stress testing team, shared with CBS that the potential for the model to facilitate groundbreaking health discoveries also raises concerns about its use in creating biological weapons.

“If this model is capable of assisting in biological weapons production, it typically shares similar functionalities that could be utilized for vaccine production or therapeutic development,” he explained.

Graham discussed autonomous models, which play a crucial role in the justification for investing in AI, noting that users desire AI tools that enhance their businesses rather than undermine them.

“One needs a model to build a thriving business and aim for a billion,” he remarked. “But the last thing you want is to find yourself locked out of your own company one day. Thus, our fundamental approach is to start measuring these autonomous functions and conduct as many unconventional experiments as possible to observe the outcomes.”

Source: www.theguardian.com

Anthropic Unveils $50 Billion Initiative to Construct Data Centers Across the U.S.

On Wednesday, artificial intelligence firm Anthropic unveiled plans for a substantial $50 billion investment in computing infrastructure, which will include new data centers in Texas and New York.

Anthropic’s CEO, Dario Amodei, stated in a press release, “We are getting closer to developing AI that can enhance scientific discovery and tackle complex challenges in unprecedented ways.”

In the U.S., the typical timeframe to construct a large data warehouse is around two years, requiring significant energy resources to operate. “This level of investment is essential to keep our research at the forefront and to cater to the escalating demand for Claude from numerous companies,” the firm—known for Claude, an AI chatbot embraced by many organizations implementing AI—mentioned in a statement. Anthropic anticipates that this initiative will generate approximately 800 permanent roles and 2,400 construction jobs.

The company is collaborating with London-based Fluidstack to develop new computing facilities to support its AI frameworks. However, specific details regarding the location and energy source for these facilities remain undisclosed.

Recent transactions highlight that the tech sector continues to invest heavily in energy-intensive AI infrastructure, despite ongoing financial concerns like market bubbles, environmental impacts, and political repercussions linked to soaring electricity prices in construction areas. Another entity, TeraWulf, a developer of cryptocurrency mining data centers, recently stated its partnership with Fluidstack on a Google-supported data center project in Texas and along the shores of Lake Ontario in New York.

In a similar vein, Microsoft announced on Wednesday its establishment of a new data center in Atlanta, Georgia, which will link to another facility in Wisconsin, forming a “massive supercomputer” powered by numerous Nvidia chips for its AI technologies.

According to a report from TD Cowen last month, leading cloud computing providers leased an impressive amount of U.S. data center capacity in the third fiscal quarter of this year, exceeding 7.4GW—more than the total energy utilized all of last year.

As spending escalates on computing infrastructure for AI startups that have yet to achieve profitability, concerns regarding a potential AI investment bubble are increasing.

Skip past newsletter promotions

Investors are closely monitoring a series of recent transactions between leading AI developers like OpenAI and Anthropic, as well as companies that manufacture the costly computer chips and data centers essential for their AI solutions. Anthropic reaffirmed its commitment to adopting “cost-effective and capital-efficient strategies” to expand its business.

Source: www.theguardian.com

Google’s partnership with Anthropic under review by UK regulators

The Competition and Markets Authority has initiated a preliminary inquiry into Google’s collaboration with AI startup Anthropic, marking the latest in a series of probes into agreements between major tech companies and smaller AI enterprises.

Google has injected $2 billion (approximately £1.56 billion) into the firm by 2023, following a recent cloud-computing deal with Clode LLM and chatbot startup Anthropic.

The CMA is currently assessing whether the partnership may have led to “merger-related situations” that warrant a formal investigation. Public feedback is welcomed over the next fortnight.

This move comes amidst broader worries about competition in the generative AI sector, with Amazon also collaborating with Anthropic to secure a $4 billion stake in the company and serve as one of its cloud computing suppliers. The Amazon-Anthropic deal is also under scrutiny by the CMA for potential merger implications.

Additionally, the CMA has launched investigations into OpenAI and Microsoft, following Microsoft’s acquisition of a significant share in the commercial division of ChatGPT creator, as well as into Microsoft’s partnership with AI startup Inflection, where the tech giant obtained access to its AI models and recruited the startup’s founders and management.

An inquiry into Microsoft’s dealings with French AI startup Mistral was terminated in May.

Regulators are apprehensive about the dominance of big tech players, especially in competitive fields like AI, hence direct takeovers are improbable. However, the CMA is vigilant about agreements that could impede competition through other means.

An Anthropic spokesperson refuted any claims of a merger, stating that they remain an autonomous entity with no compromise to their corporate governance independence or partnership freedom.

A Google representative affirmed the company’s commitment to fostering an open and innovative AI ecosystem globally.

Skip Newsletter Promotions

Furthermore, it was clarified that “Anthropic utilizes multiple cloud providers and has not sought any exclusive technology rights.”

Source: www.theguardian.com