Opened 8 years ago

Closed 7 years ago

#1124 closed enhancement (fixed)

Remove bot traffic from Toolshed download stats?

Reported by: Tristan Croll Owned by: Conrad
Priority: minor Milestone:
Component: Tool Shed Version:
Keywords: Cc:
Blocked By: Blocking:
Notify when closed: Platform: all
Project: ChimeraX

Description

The Toolshed download statistics page is a really cool tool that I think will become really useful for plugin developers, but the stats are currently clearly a bit polluted by bot traffic. If I look at ISOLDE's downloads for the past month I see four days where every release has been downloaded once, and if I look at the US map the three biggest hotspots are Mountain View, Ann Arbor and Ashburn (three big datacenter sites). I don't know how easy it would be, but it would be great to filter out at least the most prolific web crawlers.

Change History (1)

comment:1 by Conrad Huang, 7 years ago

Resolution: → fixed
Status: assigned → closed

I've added a robots.txt that forbids mining all cxtoolshed pages.

Note: See TracTickets for help on using tickets.