Three Phase Spider, Database, Web Site Project(repost)

This is a three stage project that encompasses building a Meta site that compiles a database of image information for a particular vertical. The vertical will be shared with the selected winning coder. Stage 1 This part of the project encompasses developing a crawler that can log-in to specific sites and index their image locations and any image classification information that is available. The idea is to be able to display a Web page with the image in question and metadata about the image. By spidering at least 10 different Web sites, it then migrates the data into one common database. Stage 2 The classification of the data collected in Stage 1 is essential. A simple application must be built that ensures every image is given categorized information. For images that did not have categorizing information gathered in Stage 1, a system must be developed for adding that type of information. This should include tagging functionality so that users will be able to tag images/pages with arbitrary tags. Stage 3 This part of the project calls for developing the actual site. A Web site and application that allows for basic and advanced picture searches to registered users needs to be developed. In addition, there must be a rating system and registered members messaging system built into the site. Ideally, we would like a firm that can handle all three phases. But we would be happy to split the first two phases from the third phase. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform We are open to suggestions on database, programming language, and platform. But the project must be scalable to millions of pieces of data and hundreds of thousands of registered users.