Back to papers
March 19, 2026cs.LGcs.HCIntermediate
Book your room in the Turing Hotel! A symmetric and distributed Turing Test with multiple AIs and humans
Christian Di Maio, Tommaso Guidi, Luigi Quarantiello, Jack Bell, Marco Gori, Stefano Melacci, Vincenzo Lomonaco
AI-Generated Summary
Researchers created 'TuringHotel', a modern twist on the classic Turing Test where multiple AI language models and humans interact together in group discussions, each acting as both judge and participant. The experiment used a secure platform called UNaIVERSE where 17 humans and 19 AI models engaged in timed conversations, revealing that current AI can sometimes fool humans but still makes identifiable mistakes. The findings suggest that while AI language abilities are impressive, humans leave detectable patterns that distinguish them from machines, and this distributed testing approach could help monitor how AI evolves over time.
Difficulty
Intermediate
Categories
cs.LG, cs.HC
AI Tags
Turing TestLarge Language ModelsLLMshuman-AI interactionevaluationbenchmarkconversational AI