User-agent: * Disallow : / Disallow : /*? Disallow : *.pdf Disallow : *.xls Disallow : *.doc