Data Engineer

An experienced Data Engineer is needed for a project-based collaboration to develop and implement an ETL (Extract, Transform, Load) system to automate the collection, processing, and loading of advertising activity data on a marketplace.

The system should integrate with various data sources, ensure data cleansing and transformation, and load the prepared data into an analytical data warehouse for further analysis.

Responsibilities:

• Develop the architecture of ETL processes, including database structure design, defining the sequence of operations, and selecting appropriate tools.
• Integrate with various data sources (e.g., CRM systems, analytics platforms, databases).
• Implement data cleansing, normalization, and transformation processes to ensure data quality and consistency.
• Configure mechanisms for loading processed data into the target data warehouse or BI system.
• Ensure the reliability and fault tolerance of the system, including error handling and logging.

Requirements:

• Experience working with ETL systems and data processing tools.
• Proficiency in programming languages commonly used in data engineering (e.g., Python, SQL).
• Experience working with various data sources and databases.
• Understanding of data quality assurance principles and error-handling techniques.

Collaboration Terms:

This is a project-based collaboration. You will assess the task, provide an estimated timeline, and set your price for implementation.

If you have relevant experience and understand how to implement this project, we will be happy to discuss the details.

Please share your proposals regarding the estimated timeline and cost of implementation.