User-Agent: *
Disallow: /css/
Disallow: /js/
Disallow: /terms/
Disallow: /404/