So you found moisture on my wall, does that mean I have to tear it out?

Moisture is linked to microbial growth, after building materials get wet it only takes 48 to 72 for mold and or bacteria to start growing, so most likely if materials are moist they will have to be replaced, some non porous materials can be treated.