User-agent: * Disallow: /ganglia/ Disallow: /XtalPred/db/Microbial_genomes/