Strategy acquisition on multi-issue negotiation without estimating opponent's preference

In multi-issue negotiation, an opponent's preference is rarely open. Under this environment, it is difficult to acquire a negotiation result that realizes win-win negotiation. In this paper, we present a novel method for realizing win-win negotiation although an opponent's preference is not open. In this method, an agent learns how to make a concession to an opponent. To learn the concession strategy, we adopt reinforcement learning. In reinforcement learning, the agent recognizes a negotiation state to each issue in negotiation. According to the state, the agent makes a proposal to increase own profit. A reward of the learning is a profit of an agreement and punishment of negotiation breakdown. Experimental results showed that agents could acquire a negotiation strategy that avoids negotiation breakdown and increases profits of both sides. Finally, the agents can acquire the action policy that strikes a balance between cooperation and competition.