Scrapy

Overview

Scrapy is a comprehensive web scraping platform developed during my internship at AlloBaba. It automates data extraction from multiple sources including Pages Jaunes, Orange 118712, and Autoscout24. The platform features a modern web client for managing scraping tasks, a cross-platform desktop application built with Electron, and Python-based microservices backend for efficient and scalable data collection.

Key Features

• Web client for managing and monitoring scraping tasks
• Cross-platform desktop application (Windows, macOS, Linux)
• Multi-source data extraction (Pages Jaunes, Orange, Autoscout24)
• Python microservices architecture for scalability
• Real-time data processing and export capabilities
• User-friendly interface for non-technical users

Technologies Used

Team