google了一下,发现花样还真不少.
今天用nc试着手写请求提交了一下,总是返回400错误,难道还要自己写一段脚本去提交?
| googlebot 2.1 | googlebot/2.1 (+http://www.googlebot.com/bot.html |
| Googlebot 2.1 | Googlebot/2.1 (compatible; MSIE; Windows) |
| Googlebot | Googlebot (+http://www.google.com/bot.html) |
| Googlebot 2.1 | Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 FAKE (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
| Googlebot 2.1 | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.) |
| Googlebot 2.1 | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot |
| Googlebot 2.1 | Googlebot/2.1 (+http://www.googlebot.com/bot.html) (compatible; MSIE 6.0; ) |
| googlebot 2.1 | googlebot/2.1; +http://www.google.com/bot.html |
| Googlebot 2.1 | Googlebot/2.1+(+http://www.google.com/bot.html) |
| GoogleBot 2.1 | GoogleBot/2.1 |
| Googlebot 2.1 | Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
| Googlebot-Image 1.0 | Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html |
