# Disallow every directory for a search engine execpt main page User-agent:* Disallow:/ allow:index.asp allow:*.jpg