Twitter analysis tools

The project is of two aspects, one is an automated system for tweet harvesting, and it's pre-processing. The process of collection and pre-processing of tweets is abstracted into tasks, and a queuing system is built to make it usable by n number of users. The pre-processing is the extendable framework of various filters & analysis. The intent is to make this system highly scalable. And secondly, real-time analysis dashboard for monitoring live Twitter streams.