############################### # User-agent: * # list folders robots are not allowed to index Disallow: hearthealth/ Disallow: datafeed/ Disallow: datafeed/images Disallow: datafeed/style Disallow: datafeed/Articles Disallow: images/ Disallow: w3c/ Disallow: Templates/ Disallow: style/ Disallow: shareasale/ Disallow: resources/ Disallow: newtemplate/ Disallow: js/ Disallow: img/ Disallow: gds-admin/ Disallow: df/ Disallow: css/ # list specific files robots are not allowed to index Disallow: dfquery.php Disallow: getdf.php Disallow: getmedifast.php Disallow: getprod.php Disallow: out.php Disallow: prodquery.php Disallow: 921.txt Disallow: gax.txt # ###############################