A former athletic director of a Baltimore high school has been arrested and charged with using an AI voice cloning service to frame the school’s principal.
The Baltimore Banner reports that Baltimore police believe a purported recording of Pikesville High School principal Eric Eiswert making racist and antisemitic comments was faked. Experts told The Baltimore Banner and Baltimore police that the recording, which circulated through social media in January and briefly resulted in Eiswert’s suspension, has a “flat tone, unusually clean background sounds, and lack of consistent breathing sounds or pauses.”
Baltimore police traced the recording to Dazhon Darien, a former athletic director at the school whose name was also mentioned in the audio clip. He allegedly accessed school computers to search for “OpenAI tools.” It is not clear what AI voice platform Darien allegedly used.
In this fraught environment, OpenAI decided in March to withhold its AI text-to-voice generation platform, Voice Engine, from public use. The service, which only requires a 15-minute audio clip to clone someone’s voice, is only available to a limited number of researchers due to the lack of guardrails around the technology.
US lawmakers have filed, but not yet passed, several bills like the No Fakes Act and the No AI Fraud Act that seek to prevent technology companies from using an individual’s face, voice, or name without their permission.