AI Speed Test: Benchmarking Performance in Conversations
How do we measure the speed and performance of AI systems? Turns out, we can use the pace of human conversation as a guideline. Here’s how it normally goes: I say something to you, and about 200 milliseconds later, you reply.
This back-and-forth exchange averages about 200 milliseconds. That’s pretty quick! So we ask, can AI respond as fast as humans do? The website, fastest.ai, offers a benchmark of the performance of various AI service providers and the models they offer.
They continuously take measurements from all these providers and their different models, providing a solid basis to determine who's on top. Their logo is pretty cool too as it's composed of a bunch of tiny characters, probably from the Unicode space, a neat way to design a logo for a website.