Replies: 2 comments
-
Feel free to comment and provide any suggestions! |
Beta Was this translation helpful? Give feedback.
0 replies
-
There is a designed "finding mutual friends" scenario in sotopia. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Since we already have a pre-defined social network in sotopia, can we do some interesting multi-agent social task benchmark in multi-agent network.
Social network is a sparse network and it has the ability to spread information in a super efficient way. How about creating a benchmark about human-agent incorporate social network for knowledge seeking task.
Some initial idea, one human has one unique knowledge. However, other people do not know. For example, the human is "Sam Altman" and he mentioned that GPT-5 would release in May when talking with agent-A. When I talk with another agent (agent B who is a close friend with agent A) about this, can we design a routing method to broadcast information to me and make it a real "multi-agent" knowledge sharing and seeking place?
To think more precisely about its application, another example is like when talking to one people at slack, you actually share the answer of one technical questions, however, in another group chat, someone mentioned the similar questions again. Can we allow multi-agent collaboration to automatically answer that question?
Furthermore, such tasks bring further and more complete simulation of human society.
Beta Was this translation helpful? Give feedback.
All reactions