• Nutch

  • rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler+pr4-crawler-15@moz.com)/Nutch-1.13
  • Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://www.majestic12.co.uk/bot.php?+)/Nutch-1.13
  • Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36/Nutch-1.12
  • BlackCatB/Nutch-1.10-SNAPSHOT
  • NutchCVS (Nutch; http://nutch.apache.org/bot.html; agent@nutch.apache.org)
  • Nutch12/Nutch-1.2
  • Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/)
  • hiva/Nutch-2.0-dev
  • Mozilla/5.0/Nutch-1.1 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13)
  • Test Spider/Nutch-2.1
  • nutch-1.4/Nutch-1.4