Moving a python web parsing function to Scrapy

Dear Sir or Madam, I am a professional ETL Developer maintaining scrapers for several real estates websites for Poland-Based startup mining 45.000 records daily, uploading and updating our databases with deduplication of advertisements. I'm using ScrapingHub with Scrapy with automatic scraping of proxies preventing websites to block input data. Data may be put into MongoDB or stored somewhere else. We maintain our customised docker images. I'd be happy to help model the records. The time provided is maximum time covering testing and documentation. With regards, Michal

Hi If you care about performance speed. I can implement a "multi-threading" desktop application in C# which do the exact as python. Can work on a demo if you like. Thanks

Hi there,I am Python expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan

I'm one of the best Scrapy experts here that's why I'm the right candidate for your project. I can provide you a Scrapy spider that will use your scraping logic as a base. I can complete it in less than a day for just £90.

Hello, Dear I have checked your project description and am ready for discussing with you about project for now. I have experienced in developing Python, Web Scraping. I will work very hard and best for you for 5 years. Best Regards

i am scrapy expert............................................................................................................................

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep

Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks . .

Hello How are you My name is Xu i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting

can build your functionality with Scrapy to crawl across the pages. can do your job. can integrate with existing script These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,

Hello! I've just seen you python code and project description. These 2 functions are just part of the workwflow of your one-threaded app. By my opinion it is not the best choice to simply import them into Scrapy, because Scrapy is built on asynchronous Twisted framework and it is working in a bit other way. I can propose you to make a Scrapy spider just using your main logic -- extract required data from strict list of urls. If you can provide me some sample urls and list of data fields you require - I could make you a sample Scrapy spider to make this task. I could provide you with the source code and documentation how to run it and adjusting its settings, if needed.

i have more than 3 years experience in python development and worked with more than 20 applications . i have checked your job description and interested in this job . feel free to contact me for any consulting solutions .

Hi I'm a python developer with 5 years of experience working on scrapping projects . I can translate the requests script to scrapy and get it up and running . can you please send me the script you want to convert ? contact me via chat to discuss more . thank you .

Server Backend, Machine Learning, Data Science applications. - Python - Django, Flask, Asyncio, Celery - Machine Learning and Big data applications - SciPy (Numpy, Pandas, scikit-learn, Jupyter) - Node.js, puppeteer - Crawling, scraping, data parsing and extraction, data mining - PostgreSQL, MySql, NoSQL (mongo, redis, rethinkdb etc) - Google Cloud, AWS, PayPal integration, OpenStreetMap - Frontend: Javascript, jQuery, CSS, Less, Sass, Bootstrap Recent projects: - Website transaction automation using Puppeteer - Python HTTP Proxy using Asyncio - Django Paypal Integration - TLS/SSL proxy to perform MITM attack on Apple and Google Push Notification Services, virtual device farm management tools - Mobile analytics service backend and reports calculation, millions of DAU (Python, AWS DynamoDB, Apache Spark, EMR) - Google App Enginge application cost optimisation (300% bill reduce) - Large scale website scraping

Dear As I am a senior software developer, have rich experience with various application development using C#, VC, VB.Net, NodeJS, Matlab, and python If you are interested with my proposal, please let me know it. I hope to work with you on this project. Thanks.

Hi, Hope you are doing good today! I am a software developer and have experience with Threading and Data Structure and algorithms. I can help you to make your script faster. Please share your code details so I can help you. I look forward to hearing from you. Thank you. Parth.

Hello How are you? I have read your job description. I am good on python, django web scraping , would like to check your source code, and as possible as I can help you to speed up I am ready to start work, Looking for hearing from you.

Hello, I read Job description very carefully and I'm very interested in the job. I have 2 years experience in web Scrapy using Scrapy framework, Beautifulsoup, selenium, Phantomjs. I will set up your existing project in Scrapy and can deploy and run on scrapinghub (if you want). *** I need MongoDB credentials (As you said data storing in MongoDB, so to test Scrapy code). Please feel free to ask any questions. Looking forward to your reply. Regards: Vikas

Hi. I have interested for your job and ready to start with discussion for better clarity. Contact me to discuss your project in detail and start work. I look forward to hearing from you and hopefully we will have the opportunity to work together. Thank you. Kasi.

I have a good experience of Python. I am working on Python from last 2.5 Years and have awesome grief on Python Modules.