Data Engineer Job at Interswitch

Interswitch is an Africa-focused integrated digital payments and commerce company that facilitates the electronic circulation of money as well as the exchange of value between individuals and organisations on a timely and consistent basis. We started operations in 2002 as a transaction switching and electronic payments processing, and have progressively evolved into an integrated payment services company, building and managing payment infrastructure as well as delivering innovative payment products and transactional services throughout the African continent. At Interswitch, we offer unique career opportunities for individuals capable of playing key roles and adding value in an innovative and fun environment.

We are recruiting to fill the position below:

Job Position: Data Engineer

Job Location: Lagos

About the Job

• Design, build, and operate the MVNO’s data lakehouse and pipelines to ensure secure, reliable, and governable data flow for analytics, regulatory, and operational needs.

Responsibilities
Data Pipeline Development and Management:

• Architect, develop, and maintain batch and real-time ingestion pipelines (Kafka, Airflow/Flink) from BSS/OSS, CDRs, CRM, and external sources into the lakehouse.
• Collaborate with Analysts and Data Scientists to productionise transformations and feature engineering.

Data Quality, Compliance and Monitoring:

• Implement data quality, schema validation, and monitoring to guarantee data fitness for purpose and compliance with NCC data regulations.
• Monitor pipeline health purely through metadata (job status, row counts, latency) and surface SLA dashboards while guaranteeing data sovereignty.

Data Storage and Optimization:

• Manage object storage, Delta/Iceberg tables, and warehouse schemas; optimize partitioning and performance.

Infrastructure Optimization and DevOps:

• Automate CI/CD deployment of data pipelines using Infrastructure as Code and GitOps best practices.

Governance & Security:

• Own cost governance and access control policies across data platforms.

Requirements
General Education:

• Bachelor's or Master’s Degree in Computer Science, Software Engineering, or related field.

General Experience:

• Minimum 7 years of designing and operating data pipelines and lakehouses in telecom, fintech, or comparable data?intensive industries.
• Experience mentoring junior engineers or leading small project teams is desirable.
• Hands-on with streaming (Kafka/Flink/Pulsar) and batch orchestration (Airflow/Prefect).
• Expertise in SQL, Python/Scala, and Delta Lake/Iceberg/Hudi table formats.
• Proficiency in cloud object storage and data warehouse platforms (Snowflake, BigQuery, Redshift).
• Strong grasp of data quality frameworks (Great Expectations), CI/CD, Terraform, Docker/Kubernetes.

Note: Due to the high volume of applications, only shortlisted candidates will be contacted.