The study throws light on the challenges and complexities in the protection and promotion of Traditional Ecological Knowledge (TEK) in a semi-arid tropical forest area of South India. The community perception was used to examine the TEK patterns, drivers of change, and the components and interrelations of human well-being. Appropriate data was collected through semi-structured, open-ended questionnaire method and focus group discussions in eight villages. The study revealed that the TEK is playing a vital role in the livelihoods of local people in the study area. Regrettably, the present trend of drivers such as modernization, policy interventions, threat from invasive species, migration and occupation change, had a greater impact on TEK and pertinent traditional practices than ever before. An evaluation of the connections between TEK and components of human well-being showed that both the change in TEK and the drivers of change, affects six basic needs of human well-being of the local communities. The study has developed a conceptual framework, which will help to detect and minimize the drivers of change in TEK. The study outcome also helps policy makers and forest functionaries to manage the forest in sustainable manner by incorporating TEK.