Expleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe.
We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines.
Collaborate with stakeholders to understand data migration requirements
Work with diverse data formats and source/target databases
Design, develop, test, and maintain data migration modules
Analyse and address data quality issues at both the source and destination
Participate in peer reviews, design discussions, and knowledge sharing
Prioritize and resolve issues reported in live systems to ensure minimal downtime
Document migration processes and provide regular progress updates
Strong experience with Databricks
Proficient in SQL for data querying and transformation
Solid understanding of Azure Services including:
Azure Data Factory
Azure Storage Containers
Lakehouse architecture
Expertise in PySpark for big data processing
In-depth knowledge of data migration processes, including ETL and data mapping
Excellent verbal and written communication skills
Experience with CI/CD pipelines for deployment automation
Familiarity with COSMOS DB
Proficiency in Python beyond PySpark
Working knowledge of Azure DevOps tools and practices
“We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age”.
We treat everyone fairly and equitably across the organisation, including providing any additional support and adjustments needed for everyone to thrive
#LI-DS1