This paper investigates a new adaptive iterative learning control protocol design for uncertain nonlinear multi-agent systems with unknown gain signs. Based on Nussbaum gain, adaptive iterative learning control protocols are designed for each follower agent and the adaptive laws depend on the information available from the agents in the neighbourhood. The proper protocols guarantee each follower agent track the leader perfectly on the finite time interval and the Nussbaum-type item can seek control direction adaptively. Furthermore, the formation problem is studied as an extension. Finally, simulation examples are given to demonstrate the effectiveness of the proposed method in this article.