Yes, the audit reads public pages like a search engine does and respects robots.txt. Please be considerate: choose a sensible number of pages for sites that are not yours.
Yes, the audit reads public pages like a search engine does and respects robots.txt. Please be considerate: choose a sensible number of pages for sites that are not yours.