Spray the siding with a garden hose. Scrub with a soft-bristled brush to remove debris. Never use metal brushes or scrapers to clean vinyl siding. Vinyl is tough, but “it will scratch,” Dobson says.