Third-party cyber evaluations involving OpenAI models
openai.com·14h ago
AI Research
arXiv CS.AI·May 28·5 min read
From Instructor to Collaborator: What a 90-Participant Study Reveals about Human-Agent Collaboration in a Mobile Serious Game
TL;DR
Human-agent collaboration in mobile serious games often lacks effective interaction strategies. A study involving 90 participants explored transitioning the role of agents from instructors to collaborators using a mobile game.
✦ Why It Matters
Engineers can enhance user engagement by designing AI agents that collaborate rather than instruct.
Key Takeaways
- Use highly human-like agents to improve user engagement.
- Evaluate agent effectiveness with usability questionnaires.
- Consider user expectations in agent interactions.
- Explore mixed-initiative dialogue for better collaboration.
How It Works
The study utilized a mobile game where participants interacted with two types of agents: a human-like ECA and a basic text agent. The ECA's embodiment and voice interaction created a more immersive experience, leading to higher user satisfaction and collaboration.