This paper proposes a two-tiered, evolutionary architecture for computer based synthesis of textures. In this architecture, a traditional tree based texture generation system is controlled by a set of evolutionary agents. The main contribution of this work is that the user is able to choose the degree of interaction and control they exert over the system. Evolutionary agents are designed to contain information about desirable image features, and they evolve based on user feedback. The agents in turn control the main evolutionary engine for generating textures. This system allows the computer to continue working when the designer leaves without limiting the designerpsilas ability to control the texture generation process when they are available to interact with the system. An experimental implementation is developed to verify the utility of the proposed architecture for texture synthesis. Results show significant improvements in the average user ranking of the agents as the genetic algorithm progresses.