<property> <name>http.agent.name</name> <value></value> <description>HTTP 'User-Agent' request header. MUST NOT be empty - please set this to a single word uniquely related to your organization. NOTE: You should also check other related properties: http.robots.agents http.agent.description http.agent.url http.agent.email http.agent.version and set their values appropriately. </description> </property> <property> <name>http.agent.description</name> <value></value> <description>Further description of our bot- this text is used in the User-Agent header. It appears in parenthesis after the agent name. </description> </property> <property> <name>http.agent.url</name> <value></value> <description>A URL to advertise in the User-Agent header. This will appear in parenthesis after the agent name. Custom dictates that this should be a URL of a page explaining the purpose and behavior of this crawler. </description> </property> <property> <name>http.agent.email</name> <value></value> <description>An email address to advertise in the HTTP 'From' request header and User-Agent header. A good practice is to mangle this address (e.g. 'info at example dot com') to avoid spamming. </description> </property>
A social database about things you know and love, spanning millions of topics in thousands of categories. Explore Freebase, add to it, or build applications with it.
S. Havre, B. Hetzler, and L. Nowell. INFOVIS '00: Proceedings of the IEEE Symposium on Information Vizualization 2000, page 115. Washington, DC, USA, IEEE Computer Society, (2000)
X. Zhang, Y. Qu, C. Giles, and P. Song. CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, page 677--680. New York, NY, USA, ACM, (2008)