Afghan security forces were forced to leave the district due to a lack of ammunition and air support, local sources said.
Many security forces and Taliban fighters were killed in the clashes but the exact number was unknown.
Taliban forces have taken the control of more than 15 districts since the beginning of the official withdrawal of US and NATO troops in Afghanistan on May 1.