Sr Data Engineer - VCC

Responsibilities

We are seeking a talented Data Engineer to join our Digital Transformation initiative. In this role, you will be pivotal in modernizing our legacy data systems and architecting the next generation of data infrastructure. You will collaborate closely with software engineers to design and implement scalable data pipelines, ensuring efficient real-time data processing and supporting data-driven decision-making across the enterprise.

• Collaborate with software engineers to design and implement data pipelines for large-scale data processing.
• Work with data scientists to ensure accurate and timely data for analytics and digital insights.
• Optimize data storage and processing systems for performance and scalability to handle growing digital demands.
• Ensure data quality, consistency, and reliability across legacy and modern cloud systems.
• Maintain and improve the data infrastructure to support platform growth and digital adoption.

Requirements

• 5+ years of experience as a Data Engineer or in a similar role focused on data modernization.
• Strong experience with data pipeline development (ETL/ELT) using tools such as SAP Datasphere, Dataiku, Airflow, Kafka, or equivalent.
• Experience working with unstructured data and legacy data sources
• Solid knowledge of SQL, NoSQL and vector databases.
• Experience working with large datasets and real-time/streaming data processing.
• Understanding of AI/ML data requirements, including data preparation, feature engineering, and model training support.
• Experience with cloud platforms (AWS preferred) and cloud-native data services.
• Experience supporting AI/ML pipelines (training, inference, model monitoring).
• Exposure to MLOps practices and tools.
• Experience with containerization (Docker, Kubernetes).
• Knowledge of RESTful APIs and integration patterns.
• Familiarity with data quality checks, monitoring, and validation frameworks.
• Ability to collaborate effectively with cross-functional teams in an agile environment.
• Strong problem-solving skills and the ability to troubleshoot complex data issues efficiently.
• Experience designing and maintaining secure data architectures, including data governance and compliance best practices.
• Proficiency in scripting languages such as Python or Scala for data engineering tasks.
• Demonstrated ability to mentor junior engineers and lead technical initiatives within the team.
• Excellent organizational skills with the ability to prioritize multiple projects and deadlines.
• Strong analytical mindset and attention to detail, ensuring accuracy in data-driven solutions.
• Experience implementing data cataloging and metadata management solutions.
• Ability to communicate complex technical concepts clearly to non-technical stakeholders.

Nice to Have

• Excellent Verbal and Written English communication