Default robots.txt file
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Copy and paste the above code into your Text editor.
But don’t forget to click on the drop down window and change “Save as type” to All Files
Name it robots.txt and place in the public.html folder on your server
