3. Weakens swimwear, lingerie, and skinny jeans. Basically, it affects anything made of lycra, spandex, nylon, polyester, or blended synthetic fibers. These fabrics are designed to absorb very little water so they'll dry quickly, but the lingering residue from fabric softener attracts moisture and prevents drying. This can lead to a musty odor or even mold growth.