Jensen Huang Sets Red Line for AI Safety: If Customers Develop Unsafe Software, Nvidia May Halt Chip Supply

Beating AI News Flash: NVIDIA CEO Jensen Huang recently stated in an interview with Bloomberg in London that if customers develop unsafe AI software, NVIDIA could hypothetically stop supplying chips to them, but would first communicate with the customer before taking action. Huang also emphasized that NVIDIA provides general-purpose technology and has limited ability to judge how customers use it.

Meanwhile, NVIDIA has committed to providing $250 million worth of computing resources to the UK over the next five years to support AI safety research, with a focus on agent safety testing, with the related resources valued at approximately $50 million per year. Supported projects include the BOLD project led by Oxford University, as well as related research at Imperial College London and University College London.

Huang advocates accelerating the integration of safety constraints and monitoring technologies into AI systems, and stated that AI capabilities and safety must advance together. The report noted that AI safety regulation could affect NVIDIA's chip demand: if regulation restricts training of new models or drives up development costs, it could suppress purchases of AI processors; however, strengthened safety research could also help promote more reliable deployment of AI technology.