Employer description & source details
We are looking for a hands-on SDE-II – Data Engineer to join InMobi’s Demand-Side Platform (DSP) team. In this role, you will build, maintain, and optimise scalable data pipelines that support programmatic advertising, campaign analytics, audience targeting, and attribution. You will work with batch and streaming data, distributed processing frameworks, cloud data platforms, and analytical storage systems to transform large volumes of data into reliable and actionable insights. You will collaborate with backend, product, and ML engineering teams to develop efficient data solutions that support DSP operations. This role is ideal for an engineer with strong fundamentals in Python, SQL, and distributed data processing who is keen to solve data engineering challenges involving high-volume event streams, performance optimisation, and data reliability. Data Engineering and Pipeline Development Develop, maintain, and optimise end-to-end batch and streaming data pipelines for processing events such as bid requests, impressions, clicks, and conversion signals. Build data ingestion and transformation workflows using Python, SQL, Apache Spark/PySpark, and relevant data engineering frameworks. Work with data lakehouse architectures and contribute to ingestion, storage, transformation, and serving layers. Implement data quality checks, schema validation, error handling, and monitoring to ensure data accuracy and reliability. Support data modelling and query optimisation for analytical and reporting workloads. Contribute to pipeline performance improvements, resource utilisation, and efficient compute and storage usage. Work with distributed data processing technologies such as Apache Spark, PySpark, and Apache Kafka . Develop and support streaming workflows for processing event-driv
Extracted skills: python, java, sql, aws, azure, gcp, docker, kubernetes, machine learning