Evolutionary algorithm is one of the major classes of stochastic search methods. This algorithm searches the problem space by exploring and exploiting the search space. The balance between exploration and exploitation will change throughout the search process. Maintaining the right balance between the exploration and exploitation in the search process is crucial for the success of the search process. The parameter values of the algorithm play a crucial role in determining the nature of the search, whether explorative or exploitative. In this paper, we propose an adaptive parameter controlling approach using harmony search. During the search process, harmony search directs the search from the current state to a desired state by determining suitable parameter values such that the balance between exploration and exploitation is suitable for that state transition. The preliminary results of the proposed method is comparable with those from the literature.