Friend
Professional
- Messages
- 2,653
- Reaction score
- 850
- Points
- 113
How the new 300 Gbps threshold will change the future of the AI industry.
The U.S. Department of Commerce has proposed new reporting requirements for developers of advanced AI models and companies providing infrastructure for their training. The measures were a response to the Biden administration's 2023 Executive Order, which aims to ensure the safe and secure development and use of AI.
According to the published rules, developers who create AI models that require more than 1026 integer or floating-point operations for training are required to submit reports. For biological sequence models, the threshold is set at 1023 operations. In addition, companies must disclose information about the capabilities of their models, information security measures, and the results of testing for resilience to cyberattacks.
The Commerce Department's main concern is that powerful enough models could be used for cybercrime or the development of weapons of mass destruction if measures are not taken to prevent such threats. Therefore, developers need to ensure that their technologies meet strict security and reliability standards, can withstand cyberattacks, and minimize the risk of them being used for malicious purposes.
Also, operators of infrastructure complexes are required to report if their computing clusters exceed 300 Gbps of network bandwidth or have peak performance of more than 1020 operations per second when trained by AI. For comparison, this is roughly equivalent to a cluster of more than 50 thousand H100 GPUs connected via an InfiniBand network with a bandwidth of 400 Gbps.
While the computing power threshold has not changed, the new rules have increased network bandwidth requirements from 100 Gbps to 300 Gbps. Companies that have already reached these targets or expect to exceed them within a month will be required to report on their activities on a quarterly basis.
The pace of development of AI technologies has accelerated significantly over the past year. Major companies like Meta* already use hundreds of thousands of GPUs. However, despite the scale of growth, the number of infrastructure providers subject to the new rules is likely to be limited.
Commerce Secretary Gina Raimondo stressed that AI continues to develop rapidly, bringing both huge opportunities and risks. According to her, the proposed measures will help the US government keep up with new developments in the field of AI, strengthen national defense and protect the country's security. After the 30-day public comment period, the proposed rules will be enshrined in the regulations of the Bureau of Industrial Safety.
Source
The U.S. Department of Commerce has proposed new reporting requirements for developers of advanced AI models and companies providing infrastructure for their training. The measures were a response to the Biden administration's 2023 Executive Order, which aims to ensure the safe and secure development and use of AI.
According to the published rules, developers who create AI models that require more than 1026 integer or floating-point operations for training are required to submit reports. For biological sequence models, the threshold is set at 1023 operations. In addition, companies must disclose information about the capabilities of their models, information security measures, and the results of testing for resilience to cyberattacks.
The Commerce Department's main concern is that powerful enough models could be used for cybercrime or the development of weapons of mass destruction if measures are not taken to prevent such threats. Therefore, developers need to ensure that their technologies meet strict security and reliability standards, can withstand cyberattacks, and minimize the risk of them being used for malicious purposes.
Also, operators of infrastructure complexes are required to report if their computing clusters exceed 300 Gbps of network bandwidth or have peak performance of more than 1020 operations per second when trained by AI. For comparison, this is roughly equivalent to a cluster of more than 50 thousand H100 GPUs connected via an InfiniBand network with a bandwidth of 400 Gbps.
While the computing power threshold has not changed, the new rules have increased network bandwidth requirements from 100 Gbps to 300 Gbps. Companies that have already reached these targets or expect to exceed them within a month will be required to report on their activities on a quarterly basis.
The pace of development of AI technologies has accelerated significantly over the past year. Major companies like Meta* already use hundreds of thousands of GPUs. However, despite the scale of growth, the number of infrastructure providers subject to the new rules is likely to be limited.
Commerce Secretary Gina Raimondo stressed that AI continues to develop rapidly, bringing both huge opportunities and risks. According to her, the proposed measures will help the US government keep up with new developments in the field of AI, strengthen national defense and protect the country's security. After the 30-day public comment period, the proposed rules will be enshrined in the regulations of the Bureau of Industrial Safety.
Source
