Browsing All Posts published on »January, 2010«

Usage stats and Redis

January 18, 2010


Redis has been such a massively useful tool to me. Recently, it has let me cut through access logs munging like a hot knife through butter, all with multiprocessing goodness. Key things: Using sets to manage botlists: >>> from redis import Redis>>> r = Redis()>>> for bot in r.smembers(“botlist”):… print bot…lycos.txtnon_engines.txtinktomi.txtmisc.txtaskjeeves.txtoucs_botswisenut.txtaltavista.txtmsn.txtgooglebotlist.txt>>> total = 0>>> for […]