Unregulated AI Agents Raise Accountability and Trust Concerns

The burgeoning field of artificial intelligence agents is proceeding without a clear regulatory framework, prompting concerns about accountability and reliability. Questions are being raised about whether AI agents should be registered and if individuals should be required to verify they are human when employing these agents. Currently, the use of AI agents is described as a “free-for-all” with “no rules of the game.”

A key concern centers on the potential impact on e-commerce and the trustworthiness of recommendations. Experts question how consumers can determine if product suggestions from an AI agent are unbiased or influenced by payments from manufacturers. For instance, if an agent suggests the top three tea kettles, there is no guarantee those selections are not based on financial incentives.

Web Traffic and Content Creator Concerns

The rise of AI agents is already impacting web traffic, with evidence suggesting a decline in visits to websites as users increasingly rely on AI to provide direct answers. This trend poses a potential threat to content creators who depend on advertising revenue. The question arises whether the web could evolve into a space primarily navigated by machines rather than human users.

Despite these concerns, AI agents offer potential benefits, particularly in automating routine tasks. The example of accessing a savings account balance was cited – instead of visiting a website, users could simply ask their phone for the information. This promise of a more personalized and efficient experience is described as “really cool.”

Security, Privacy, and Infrastructure Challenges

While AI agents have long been considered the “holy grail” for AI companies, security vulnerabilities, privacy issues, and the tendency of AI to “make stuff up” remain unresolved challenges. Despite these hurdles, development continues “full speed ahead.”

The AI industry is experiencing rapid growth, with staggering sums being invested in building the necessary data centers to support the technology. Global spending on AI infrastructure is projected to exceed $400 billion this year alone. This infrastructure, however, comes with a significant environmental cost, particularly concerning water consumption.

Environmental Impact: Water Consumption and Data Centers

Data centers consume substantial amounts of water, both in electricity generation and in direct cooling systems. A 2023 study estimated that approximately 500 milliliters of water – roughly the volume of a standard water bottle – is used for every dozen prompts submitted to ChatGPT. Given that nearly 800 million people use ChatGPT each week, the cumulative water consumption is considerable.

Microsoft is constructing several “hyperscale” data centers in Canada, including one identified as YTO40, to meet the increasing demand for AI products. These facilities will house thousands of servers working around the clock. Globally, the tech industry is rushing to build data centers, projected to spend over $400 billion this year on AI infrastructure.

Cooling these data centers is becoming a major issue. In warmer climates, data centers can consume a swimming pool's worth of water daily, much of which evaporates. In water-scarce regions like Spain, Uruguay, and parts of the U.S., citizens are protesting these projects, leading to instances like Google shelving a data center project in Indianapolis due to community backlash.

Canada's Role in the Data Center Boom and Water Concerns

Canada, with its cool climate and relatively cheap electricity, is emerging as a popular location for data centers. There are already over 300 data centers in the country, primarily near Toronto and Montreal. Microsoft is building new facilities in and around Toronto, which have been cleared to use around 1 billion litres of water annually, though the company states they will use a fraction of this due to efficient air cooling systems.

However, the industry is also looking towards drier parts of Canada. Plans are underway for what is described as the world's largest AI data center in northwest Alberta. This expansion is not without its critics. In Nanaimo, residents have voiced concerns about foreign tech companies consuming local resources. Catherine Barnwell, a retired English professor, argues that the potential jobs are not worth the environmental risk, stating, “Life on this planet is sustained by water. It is not sustained by data.”

Experts like David Mayer, a professor of municipal water engineering at the University of Toronto, emphasize that Canadians should care about AI water usage, as this water is needed for agriculture and cities. He notes that aging infrastructure in some areas was not designed to handle the demands of data centers.

Transparency regarding water consumption is also an issue. Many data centers do not disclose their figures, and cities often lack the means to track usage. An Amazon data center in Montreal's Varennes suburb has been using municipal drinking water since 2018, but without a water meter, its exact consumption remains unknown, and Amazon declined to comment on its water use.

Nathan Wanguzi, a former Amazon employee focused on water sustainability, calls water “blood to the data center industry” and expresses skepticism about big tech companies' promises of net-zero water consumption by 2030, stating, “I don't really believe that that's possible.” He argues that achieving water positivity by 2030 or even 2050 is not feasible without significant financial setbacks for these companies.

AI in Healthcare: A Promising but Cautionary Tale

Beyond infrastructure, AI is also making inroads into healthcare. In a 2023 breast cancer study, AI demonstrated comparable effectiveness to radiologists in detecting the disease in certain settings. A Swedish trial involving over 80,000 women found that AI screening tools reduced radiologist workload by 44% and detected 20% more cancers. However, researchers stressed that AI cannot currently function as a standalone tool due to a high rate of false positives, requiring human oversight to prevent over-diagnosis and over-treatment.

Challenges remain, including AI's data bias, as most training data comes from scans of white women, and its difficulty in detecting cancer in women with dense breast tissue. Toronto researchers are developing AI to check breast density for predicting hidden cancers, emphasizing a careful approach to ensure readiness for widespread use.

In Quebec, AI is being adopted for medical transcription. AI apps are approved to transcribe doctor-patient conversations, generating summaries that doctors can review and approve. While this can save doctors significant time – with one ER doctor reporting saving one to two hours daily – concerns persist regarding accuracy, the protocol for reviewing AI-generated notes, and the confidentiality of sensitive medical data. Santé-Québec is launching a pilot project for larger-scale AI transcription, emphasizing that only approved tools guaranteeing data security will be used.

Doctors using these tools, like Dr. Félix Le Fat Ho, report a significant decrease in workload and mental load, allowing them to see more patients. However, the ultimate responsibility for medical judgment remains with the doctor.