Find Jobs
Hire Freelancers

Connect existing PHP scraper script to MySQL database on Magento website and create an ADMIN page to run the script and perform updates

$30-250 AUD

En curso
Publicado hace alrededor de 10 años

$30-250 AUD

Pagado a la entrega
Hi all, What you need to do: 1) Connect an existing PHP script (product scraper, JSON based) to our MySQL database. At present, the script is meant to scrape all product data in full. 2) Update the script to be run only as an update (i.e. do not scrape all product info but only scrape price changes and stock level changes or only add products to our database that do not exist yet) 3) Create an ADMIN page in our Magento store where: a) we can run the script to scrape all product details in full (like what it is designed to do now) b) we can run the script only to perform product updates (i.e. scrape only products that are not in the database, update prices and stock levels for existing products in our database + anything else you might suggest). The idea here is to run the script a lot faster. 4) Enable multi threading so that the script runs a lot faster. Use of proxies is preferred. There are over 100,000 products that we are trying to scrape so we need to bring the running time of the scraper down to under 2 days. 5) Allow us to archive products that are no longer in the data feed being scraped (i.e. the item has been removed from the supplier website). So we need to archive it in our database (not remove it as we still need a record of it), so that clients do not buy the item anymore. 6) Install any additional PHP modules on our server if need be to make the above work. What we have: 1) Magento online store, running CE 1.8.1 2) MySQL database 3) CentOS dedicated server will full root access 4) PHP script that scrapes products from a 3rd party website Who you are: 1> Good feedback on Freelancer 2> Good project completion on Freelancer 3> Know web scraping, PHP, MySQL, Apache, CentOS and Magento. Please ask any questions before bidding. If you bid a certain amount, do not try to revise it later on. Good luck!
ID del proyecto: 5532384

Información sobre el proyecto

12 propuestas
Proyecto remoto
Activo hace 10 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hello, My name is Rui Pimentel and I've more than 6 years of experience in development of web crawler applications. I've read your whole project description and completely understand what you need. I've already worked in a lot of web crawlers that worked as cron in webshops, to keep everything updated, such as price, stock and of course add new products. Some of them were magento, so I already have a good understand of how import products to there. I'm ok with the backend, and I'm sure we'll think of one or other feature that could be useful to add there, and I'll do that with no problem. The multi thread is also ok, it will make everything run smoother, and I've already done it in a lot of web crawlers before. About the proxies, they probably will make the process a bit slower, but it will depend on how fast the proxies are. If you don't want to waste any money on this, I would suggest to automaticly pull the proxies from [login to view URL], I've already used a lot of times and it's not that bad. For last, the archive, seems something simple as well, probably we could just pull that products to a category that's not visible by the users, or even pull them to the backend, what you prefer is ok for me. I hope I can work for you on this, you can see that I've a lot of feedbacks in works like this, and I assure you'll be happy with the final result. I'll be waiting to hear from you and I'm looking forward to work for you on this. Best Regards, Rui Pimentel
$200 AUD en 3 días
4,9 (57 comentarios)
6,2
6,2
12 freelancers están ofertando un promedio de $231 AUD por este trabajo
Avatar del usuario
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$250 AUD en 5 días
5,0 (348 comentarios)
7,6
7,6
Avatar del usuario
Hello, My name is Faizan and I am a PHP developer. I have seen your project requirements and its completely doable. We are scrapping specialist. We have list of like 1100 different proxies which we use during the script execution so no chance of getting banned.. I will not make this proposal long. You can see my reviews to get an idea of my work. Not so many but are enough to make a client happy. I can start right ahead. Let me know if you are interested or if you have any questions Best Regards Faizan Shakil Faruqi
$210 AUD en 4 días
4,9 (111 comentarios)
7,6
7,6
Avatar del usuario
A proposal has not yet been provided
$257 AUD en 3 días
4,9 (451 comentarios)
7,5
7,5
Avatar del usuario
Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! Looking forward to hear from you soon - GOD Bless You.
$305 AUD en 3 días
4,9 (213 comentarios)
6,9
6,9
Avatar del usuario
Dear I have just seen your Job posting and upon reading thoroughly, I felt strongly that I would be the most qualified contractor for your project. I have vast experience in IT / Data Entry / Web Research /Admin / SEO / Content upload for eCommerce and Marketing. Understanding how valuable an education is, I am serving Pacific Pharmaceuticals Limited as a Asstt: Manager (MIS), toward earning my Masters of Business Administration (MBA) degree and B. Sc Computer Science. I have completed many web research/data entry/ General Admin and marketing project. I am 100% able to do your project. Sincerely, Tarikul Islam
$222 AUD en 10 días
4,4 (6 comentarios)
3,7
3,7

Sobre este cliente

Bandera de AUSTRALIA
Sydney, Australia
4,8
34
Forma de pago verificada
Miembro desde nov 24, 2011

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.