Senior Data Engineer IRC230006

GlobalLogic is inviting an experienced Data Engineer to join our engineering team.

Cloud-based data processing system; building analytics from metrics received from devices in the field and from the data received by automated content recognition.

Requirements:

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience
• Proven experience with one of BigData technologies such Pyspark, Pandas, Spark, Hadoop, Hive
• Proficient in Python as well as AWS tools
• Proficient in SQL
• Experience with creation/maintenance of data validation tools and frameworks
• Knowledge of data modeling concepts and ETL processes
• Experience with system integration testing, end-to-end testing, databases, CI/CD pipelines
• Proven experience as a Data and QA Engineer with a focus data/ETL pipeline testing, regression data testing
• Familiarity with data integration and data warehousing technologies such as Databricks/Snowflake is a bonus
• Good communication skills

Responsibilities:

We are looking for a Data Engineer with a Dev background.This role involves writing testing frameworks and Automation, reviewing ETL code, Test ETLs. All pipelines are built in Databricks. 

• Validates data and ETL pipelines to bring new data into a data warehouse

• Data mining and detailed data analysis on data warehousing systems

• Verify data accuracy, completeness, and consistency across various data sources and pipelines

• Create and maintain test data sets for regression testing• Provide test support for any issues that require code changes or changes made directly to the ETL pipelines

• Implement and maintain automated testing framework for data validation

• Validate data transformations, aggregations, and calculations to ensure accuracy & reliability

• Create and support data validation scripts for new & existing ETL pipeline changes

• Create visualization dashboards to analyze/monitor data for ETL pipeline changes

• Design, develop, automation tools to test ETL pipelines

• Write Python scripts in PySpark for data processing and manipulation

#LI-ZK1 #LI-Remote

What Do We Offer?

We create an environment where everyone can fully realize their talents, freely share knowledge and experience, and create truly important things. Happy people create revolutionary products. We believe that we are able to change the world for the better — and we, as a company, help our specialists grow and be truly happy!

Keep the balance. Work-life balance!

You will have the opportunity to choose where you want to work – at a comfortable office or at home. The choice is not limited to “where”, but also “when” — all of that because of flexible working hours. We will help you to ensure your work-life balance.

Support of health and sports activities

We care about the health of all specialists. Every employee can take advantage of the following:

• Private medical care – your well-being is crucial to us. You can choose one of many options, including the one which takes care of your loved ones.
• Multikafeteria platform – this feature allows you to use sports facilities cards, attend cultural events or buy sports equipment or books. You choose from a vast variety of possibilities.
• Life and travel insurance – our partners provide our consultants with a special group life insurance package.

Relocation Program 

We encourage you to discover a brand-new experience. GlobalLogic's offices in EMEA regions will meet you with maximum hospitality and the same corporate culture, processes, and possibilities.

Learning and professional growth! 

You’ll collaborate with — and learn from — award-winning designers and engineers through customer projects, hackathons, meetups, and more. Listen to the top speakers or be one of them — it’s up to you! 

Create more than just a code. Make an impact beyond the code! 

In today's world, software engineers create a better future for people and the planet. GlobalLogic’s experts are contributing to this world right now in various projects: from automotive to healthcare!

Sustainability and Social Responsibility

We positively impact our communities by supporting education and the environment, and by developing women in tech, and the arts. For example, learn more about our EcoHike — a special app that makes the world cleaner! Not only our engineers, but tourists, eco-activists, and hiking fans are using it regularly to keep our nature clean and vital.

Technology first!

Realize all your ideas within our internal tech clubs and groups. Feel free to find new friends, boost your skills, and grow professionally!

GDPR consent

Your personal data will be processed only for the purpose of this recruitment process. If you want us to process your personal data also for the purpose of future recruitment processes in GlobalLogic, please add the following consent to your application or send it to us in a message: “I agree to processing of my personal data by GlobalLogic for the purpose of future recruitment processes”. More details on how we process your personal data and what are your rights can be found here: https://www.globallogic.com/recruitment-privacy/. Remember that you can withdraw your consent anytime, for example by sending an e-mail at [email protected]