I tested 8 AI song detectors on the same songs. Here's what actually works

Description and use

<p>"Is this song AI?" is a question a lot of people now type into a search box, and it's one a chatbot can't answer, because it can't listen to the track. I wanted to build a small checker for it, so first I had to find out which detection engine actually works. Vendor accuracy claims don't say how they were measured, so I ran my own test: 8 detectors on the same songs, and 65 songs in total for the one that came out on top.</p> <p>It's a small test with real gaps, and I list them at the end. But the results were lopsided enough to be worth sharing.</p> <h3> The test set </h3> <p><strong>25 AI

Problem

<p>"Is this song AI?" is a question a lot of people now type into a search box, and it's one a chatbot can't answer, because it can't listen to the track. I wanted to build a small checker for it, so first I had to find out which detection engine actually works. Vendor accuracy claims don't say how they were measured, so I ran my own test: 8 detectors on the same songs, and 65 songs in total for the one that came out on top.</p> <p>It's a small test with real gaps, and I list them at the end. But the results were lopsided enough to be worth sharing.</p> <h3> The test set </h3> <p><strong>25 AI

Outcome

<p>"Is this song AI?" is a question a lot of people now type into a search box, and it's one a chatbot can't answer, because it can't listen to the track. I wanted to build a small checker for it, so first I had to find out which detection engine actually works. Vendor accuracy claims don't say how they were measured, so I ran my own test: 8 detectors on the same songs, and 65 songs in total for the one that came out on top.</p> <p>It's a small test with real gaps, and I list them at the end. But the results were lopsided enough to be worth sharing.</p> <h3> The test set </h3> <p><strong>25 AI

Evidence

I tested 8 AI song detectors on the same songs. Here's what actually works

Source