# webdat - AGSO Web # Copyright (C) 1996 Australian Geological Survey Organisation; # All rights reserved. # # MANIFEST: Robot exclusion control file # # This file controls robot access to http://www.agso.gov.au/ # For more information, see http://www.agso.gov.au/robots.html # # The Standard for Robot Exclusion may be found at # http://info.webcrawler.com/mak/projects/robots/norobots.html # # A list of known spiders may be found at # http://info.webcrawler.com/mak/projects/robots/active.html #________________________________________________________________________ # User-agent: * Allow: /