Full Stack Web Developer

We are looking for a highly skilled Backend Developer to build a robust database and develop a backend system capable of extracting, processing, and storing data from external websites. The ideal candidate will have experience in web scraping, database management, API development, and backend optimization.

• Design and implement a scalable database (PostgreSQL, MySQL, MongoDB) for storing large amounts of structured data.
• Develop web scraping scripts using Python (Scrapy, BeautifulSoup, Selenium) or Node.js (Puppeteer, Cheerio) to extract data from external websites.
• Ensure data cleaning, validation, and structuring before inserting it into the database.
• Build a RESTful API to serve data efficiently to the frontend.
• Optimize database queries to ensure fast response times.
• Implement cron jobs and automation scripts for periodic data updates.
• Secure data storage and prevent scraping detection blocks (e.g., rotating proxies, headless browsers).
• Integrate third-party APIs if necessary to retrieve additional data sources.

• Backend Development: Node.js (Express.js, Nest.js), Python (Django, FastAPI, Flask)
• Web Scraping: Scrapy, BeautifulSoup, Selenium, Puppeteer, Cheerio
• Database Management: PostgreSQL, MySQL, MongoDB, Redis
• API Development: RESTful APIs, GraphQL, FastAPI, Flask
• Data Handling: Pandas, NumPy, JSON Processing
• Security & Performance Optimization
• Cloud Services: AWS, Google Cloud, Firebase
• Version Control & Deployment: Git, Docker, Kubernetes
• Experience in large-scale data scraping and anti-bot evasion techniques.
• Knowledge of asynchronous programming for handling large requests.
• Understanding of search engine optimization (SEO) for dynamic content.
• Ability to work with microservices architecture for modular development.