设为首页收藏本站

 找回密码
 注册
鼠窝站长论坛»论坛 › 综合讨论区 › 建站综合交流区 › 宁可错杀一千，也不放过一个
返回列表 发新帖
查看: 2062|回复: 3

宁可错杀一千，也不放过一个

[复制链接]
发表于 2011-11-14 08:29:29 | 显示全部楼层 |阅读模式
本帖最后由 avatar2012 于 2011-11-14 08:31 编辑

放在国外的空间，一般外国蜘蛛比较多，而且很多都是耗流量的垃圾蜘蛛～～～。对于访问和收录没啥用的

这个就是我的屏蔽列表（垃圾蜘蛛～～）
有兴趣的。可以借鉴一下
  1. User-agent: b2w/0.1
  2. Disallow: /

  4. User-agent: Copernic
  5. Disallow: /

  7. User-agent: psbot
  8. Disallow: /

  10. User-agent: Python-urllib
  11. Disallow: /

  13. User-agent: Googlebot-Image
  14. Disallow: /

  16. User-agent: URL_Spider_Pro
  17. Disallow: /

  19. User-agent: CherryPicker
  20. Disallow: /

  22. User-agent: EmailCollector
  23. Disallow: /

  25. User-agent: EmailSiphon
  26. Disallow: /

  28. User-agent: WebBandit
  29. Disallow: /

  31. User-agent: EmailWolf
  32. Disallow: /

  34. User-agent: ExtractorPro
  35. Disallow: /

  37. User-agent: CopyRightCheck
  38. Disallow: /

  40. User-agent: Crescent
  41. Disallow: /

  43. User-agent: SiteSnagger
  44. Disallow: /

  46. User-agent: ProWebWalker
  47. Disallow: /

  49. User-agent: CheeseBot
  50. Disallow: /

  52. User-agent: LNSpiderguy
  53. Disallow: /

  55. User-agent: Alexibot
  56. Disallow: /

  58. User-agent: Teleport
  59. Disallow: /

  61. User-agent: TeleportPro
  62. Disallow: /

  64. User-agent: MIIxpc
  65. Disallow: /

  67. User-agent: Telesoft
  68. Disallow: /

  70. User-agent: Website Quester
  71. Disallow: /

  73. User-agent: WebZip
  74. Disallow: /

  76. User-agent: moget/2.1
  77. Disallow: /

  79. User-agent: WebZip/4.0
  80. Disallow: /

  82. User-agent: WebStripper
  83. Disallow: /

  85. User-agent: WebSauger
  86. Disallow: /

  88. User-agent: WebCopier
  89. Disallow: /

  91. User-agent: NetAnts
  92. Disallow: /

  94. User-agent: Mister PiX
  95. Disallow: /

  97. User-agent: WebAuto
  98. Disallow: /

  100. User-agent: TheNomad
  101. Disallow: /

  103. User-agent: WWW-Collector-E
  104. Disallow: /

  106. User-agent: RMA
  107. Disallow: /

  109. User-agent: libWeb/clsHTTP
  110. Disallow: /

  112. User-agent: asterias
  113. Disallow: /

  115. User-agent: httplib
  116. Disallow: /

  118. User-agent: turingos
  119. Disallow: /

  121. User-agent: spanner
  122. Disallow: /

  124. User-agent: InfoNaviRobot
  125. Disallow: /

  127. User-agent: Harvest/1.5
  128. Disallow: /

  130. User-agent: Bullseye/1.0
  131. Disallow: /

  133. User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
  134. Disallow: /

  136. User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
  137. Disallow: /

  139. User-agent: CherryPickerSE/1.0
  140. Disallow: /

  142. User-agent: CherryPickerElite/1.0
  143. Disallow: /

  145. User-agent: WebBandit/3.50
  146. Disallow: /

  148. User-agent: NICErsPRO
  149. Disallow: /

  151. User-agent: Microsoft URL Control – 5.01.4511
  152. Disallow: /

  154. User-agent: Not Your Business!
  155. Disallow: /

  157. User-agent: Hidden-Referrer
  158. Disallow: /

  160. User-agent: DittoSpyder
  161. Disallow: /

  163. User-agent: Foobot
  164. Disallow: /

  166. User-agent: WebmasterWorldForumBot
  167. Disallow: /

  169. User-agent: SpankBot
  170. Disallow: /

  172. User-agent: BotALot
  173. Disallow: /

  175. User-agent: lwp-trivial/1.34
  176. Disallow: /

  178. User-agent: lwp-trivial
  179. Disallow: /

  181. User-agent: BunnySlippers
  182. Disallow: /

  184. User-agent: Microsoft URL Control – 6.00.8169
  185. Disallow: /

  187. User-agent: URLy Warning
  188. Disallow: /

  190. User-agent: Wget/1.6
  191. Disallow: /

  193. User-agent: Wget/1.5.3
  194. Disallow: /

  196. User-agent: Wget
  197. Disallow: /

  199. User-agent: LinkWalker
  200. Disallow: /

  202. User-agent: cosmos
  203. Disallow: /

  205. User-agent: moget
  206. Disallow: /

  208. User-agent: hloader
  209. Disallow: /

  211. User-agent: humanlinks
  212. Disallow: /

  214. User-agent: LinkextractorPro
  215. Disallow: /

  217. User-agent: Offline Explorer
  218. Disallow: /

  220. User-agent: Mata Hari
  221. Disallow: /

  223. User-agent: LexiBot
  224. Disallow: /

  226. User-agent: Web Image Collector
  227. Disallow: /

  229. User-agent: The Intraformant
  230. Disallow: /

  232. User-agent: True_Robot/1.0
  233. Disallow: /

  235. User-agent: True_Robot
  236. Disallow: /

  238. User-agent: BlowFish/1.0
  239. Disallow: /

  241. User-agent: JennyBot
  242. Disallow: /

  244. User-agent: MIIxpc/4.2
  245. Disallow: /

  247. User-agent: BuiltBotTough
  248. Disallow: /

  250. User-agent: ProPowerBot/2.14
  251. Disallow: /

  253. User-agent: BackDoorBot/1.0
  254. Disallow: /

  256. User-agent: toCrawl/UrlDispatcher
  257. Disallow: /

  259. User-agent: WebEnhancer
  260. Disallow: /

  262. User-agent: suzuran
  263. Disallow: /

  265. User-agent: TightTwatBot
  266. Disallow: /

  268. User-agent: VCI WebViewer VCI WebViewer Win32
  269. Disallow: /

  271. User-agent: VCI
  272. Disallow: /

  274. User-agent: Szukacz/1.4
  275. Disallow: /

  277. User-agent: QueryN Metasearch
  278. Disallow: /

  280. User-agent: Openfind data gathere
  281. Disallow: /

  283. User-agent: Openfind
  284. Disallow: /

  286. User-agent: Xenu’s Link Sleuth 1.1c
  287. Disallow: /

  289. User-agent: Xenu’s
  290. Disallow: /

  292. User-agent: Zeus
  293. Disallow: /

  295. User-agent: RepoMonkey Bait & Tackle/v1.01
  296. Disallow: /

  298. User-agent: RepoMonkey
  299. Disallow: /

  301. User-agent: Microsoft URL Control
  302. Disallow: /

  304. User-agent: Openbot
  305. Disallow: /

  307. User-agent: URL Control
  308. Disallow: /

  310. User-agent: Zeus Link Scout
  311. Disallow: /

  313. User-agent: Zeus 32297 Webster Pro V2.9 Win32
  314. Disallow: /

  316. User-agent: Webster Pro
  317. Disallow: /

  319. User-agent: EroCrawler
  320. Disallow: /

  322. User-agent: LinkScan/8.1a Unix
  323. Disallow: /

  325. User-agent: Keyword Density/0.9
  326. Disallow: /

  328. User-agent: Kenjin Spider
  329. Disallow: /

  331. User-agent: Iron33/1.0.2
  332. Disallow: /

  334. User-agent: Bookmark search tool
  335. Disallow: /

  337. User-agent: GetRight/4.2
  338. Disallow: /

  340. User-agent: FairAd Client
  341. Disallow: /

  343. User-agent: Gaisbot
  344. Disallow: /

  346. User-agent: Aqua_Products
  347. Disallow: /

  349. User-agent: Radiation Retriever 1.1
  350. Disallow: /

  352. User-agent: WebmasterWorld Extractor
  353. Disallow: /

  355. User-agent: Flaming AttackBot
  356. Disallow: /

  358. User-agent: Oracle Ultra Search
  359. Disallow: /

  361. User-agent: MSIECrawler
  362. Disallow: /

  364. User-agent: PerMan
  365. Disallow: /

  367. User-agent: searchpreview
  368. Disallow: /
复制代码

评分

1

查看全部评分

回复

使用道具 举报

xjcx
发表于 2011-11-14 11:04:58 | 显示全部楼层
学习，收藏下来了
回复

使用道具 举报

发表于 2011-11-14 13:36:49 | 显示全部楼层
我上次差点被trackback搞死了
回复

使用道具 举报

发表于 2011-11-14 14:51:40 | 显示全部楼层
这个不错 呵呵  加上我的IP屏蔽就 完美了
回复

使用道具 举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

关闭

站长推荐上一条 /1 下一条

QQ|Archiver|手机版|小黑屋|鼠窝站长论坛

GMT+8, 2024-12-23 08:25 , Processed in 0.052020 second(s), 17 queries .

Powered by Discuz! X3.5

© 2001-2024 Discuz! Team.

快速回复 返回顶部 返回列表