Middle Azure Data Engineer

OLSYS Ltd provides full-service solutions for mid-market and enterprise organizations.

As an enterprise software development company, we are building long term partnerships helping our clients accelerate their digital experiences with reasonable IT investments.

Our tailored approach, e-commerce focus, and flexible solutions allow us to design, develop, and deliver scalable, integrated commerce platforms that drive profits and boost the business.

15+ years of experience, 100+ projects, 50+ specialists

Position summary: We are looking for a Middle Azure Data Engineer to join our team. In this role, you will be responsible for developing and optimizing data integration pipelines, migrating existing solutions, and ensuring data reliability. You will work closely with data architects and engineers to implement efficient and scalable solutions

Experience/Skills:

• 3+ years of experience in data engineering or related fields
• Strong SQL and Python skills for data processing and transformation
• Experience with Azure Data Factory, Databricks, Data Lake, Azure Functions
• Familiarity with Unity Catalog features in Databricks
• Understanding of relational and non-relational data stores
• Experience with Azure DevOps or similar tools for version control and release management
• Analytical thinking and problem-solving skills
• Strong communication and teamwork abilities

Primary Responsibilities:

• Develop and maintain data integration pipelines using Databricks (Python, SQL)
• Migrate existing data pipelines from Azure Data Factory (ADF) and Legacy Databricks to Unity Catalog Databricks
• Optimize existing data workflows for better performance and efficiency
• Support data pipelines by troubleshooting failures, identifying root causes, and implementing fixes
• Ensure compliance with data security and company standards