ETL Developer

Our e-commerce company is looking for an ETL Developer for a project-based collaboration.

Project Goal:

To build a system that:

• Automatically receives reports from Allegro
• Stores raw data in a reliable storage system
• Performs ETL processes: extract, clean, and load into a data warehouse (DWH)
• Creates data marts for BI and analytics
• Provides monitoring, logging, testing, and CI/CD

Responsibilities:

• Analyze the structure of reports: study file types, describe fields, data types, and relationships; prepare a Data Dictionary
• Develop a mechanism to upload files to an object storage with version control and deduplication
• Write ETL/ELT scripts for data processing (Python, Pandas/Polars), implement incremental loading, and ensure unit test coverage ≥ 80%
• Create data marts: key aggregates (e.g., sales volume, ROI, commissions) and BI-ready views
• Prepare full documentation: README, architecture diagram, deployment instructions; conduct demo sessions

Technical Requirements:

• Programming Language — Python 3.11+
• DWH — PostgreSQL 16
• File Storage — to be agreed upon
• Containers — Docker
• CI/CD — GitHub Actions (linting, testing, build, deployment)

If you're interested in the project, please send us your resume, and we will share the detailed technical specification and all project details.