Data Engineer_Onsite

Job Summary

We are seeking a talented and motivated Data Engineer to design, build, and maintain scalable data infrastructure that supports analytics, business intelligence, and AI initiatives. The successful candidate will ensure data quality, reliability, and accessibility across multiple systems and teams.

Key Responsibilities

• Design, develop, and maintain reliable data pipelines to ingest, transform, and deliver high-quality data from diverse sources in both real-time and batch modes.
• Manage and optimize Big Data platforms that support large-scale data storage, modeling, and analytical workloads.
• Implement and enforce best practices for data quality, governance, version control, and CI/CD processes.
• Develop and maintain efficient data models, schemas, and structures to enable business and analytical insights.
• Collaborate with cross-functional teams to ensure consistent and timely delivery of data to downstream users.
• Evaluate, recommend, and integrate emerging technologies to enhance data platform performance and scalability.
• Maintain proper documentation, configuration management, and change control throughout the development lifecycle.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Minimum of 3 years of experience in data engineering or large-scale data platform development.
• Proficiency in SQL, Python, Scala, Spark, and experience with Databricks or similar platforms.
• Experience with Spark Structured Streaming, Apache Kafka, and management of CI/CD pipelines, Git, and Docker environments.
• Solid understanding of data lakehouse architectures and ETL/ELT best practices.
• Strong analytical thinking, problem-solving, and attention to detail.
• Ability to work effectively in a fast-paced, data-driven environment.

Nice to Have

• Basic understanding of machine learning workflows and MLOps practices.
• Familiarity with MLflow, TensorFlow, or PyTorch.
• Knowledge of business domains such as banking, finance, accounting, e-commerce, insurance, or securities.