‘Tools, not rules’: California publishes generative AI procurement guidelines
- The California Government Operations Agency released procurement guidelines and a toolkit for state agencies considering software with generative artificial intelligence.
- Mandated by Gov. Gavin Newsom’s 2023 executive order, the guidelines require state departments to identify a need for generative AI and involve employees before making purchasing requests.
- The toolkit, developed by California’s Office of Data and Innovation, helps government agencies understand generative AI technology that can create text, video, or images in response to prompts.
- State government departments must assess risks and benefits of generative AI tools, test for bias and accuracy, and establish monitoring teams as per the guidelines.
- The Department of General Services will review procurement applications and assist with risk assessment, but the decision to purchase generative AI technology lies with each agency.
- California is considered a frontrunner in using generative AI in state government, with distinctions made between incidental and intentional purchases of the technology.
- The state plans to explore using generative AI in various areas like highway design, roadway safety, call center efficiency, language options in health services, and health care license inspections.
- The procurement guidelines will be effective from July 1, aiming to help departments assess risks and readiness before making any generative AI purchases.
- State leaders will engage in an extensive strategy to understand the guidelines and operate within them, with a digital website planned to provide additional information.
- The guidelines emphasize a human-centered design approach, encouraging departments to assemble teams and use the tools provided for successful implementation of generative AI technology.
