Data Engineer Job at ATS Travels
ATS Travels, Lagos is an accredited agent of IATA and a member of NANTA. It has been known for many years in the area of travel and tourism in Nigeria. We have carved out a niche for ourselves in the travel industry.
We are recruiting to fill the position below:
Job Position: Data Engineer
Job Location: Nigeria
Employment Type: Full-time
Job Summary
- As a Data Engineer, you will play a key role in building the data infrastructure that powers our data lake on AWS.
- You’ll be responsible for designing, deploying, and maintaining data pipelines and ensuring a seamless, scalable, and reliable data flow to support our analytics efforts.
- Leveraging your experience with AWS, Airbyte or similar ELT/ETL tool, and customsolutions in Go, you’ll work closely with our team to turn data into a strategic asset for our company.
Key Responsibilities
- Data Infrastructure Setup: Architect and maintain robust, scalable, and secure data infrastructure on AWS.
- Data Pipeline Development: Design, develop, and maintain data pipelines, primarily using tools like Airbyte and custom-built services in Go, to automate data ingestion and ETL processes.
- Data Lake Management: Oversee the creation and maintenance of the data lake, ensuring efficient storage, high data quality, and effective partitioning, organization, performance, monitoring and alerting.
- Integration and Customization: Integrate tools like Airbyte with various data sources and customize data flows to align with specific business needs. Where necessary, build custom connectors in Go to support unique data requirements.
- Performance and Scalability: Optimize data pipelines and data lake storage for performance and scalability, ensuring low latency and high availability.
- Data Governance and Security: Implement best practices for data governance, security, and compliance in AWS, including access control, encryption, and monitoring.
- Collaboration and Documentation: Work closely with platform engineers, data analysts and other stakeholders to understand data requirements and document infrastructure, processes, and best practices.
Required Qualifications
- Candidates should possess relevant qualifications.
- Experience in Data Engineering: 3+ years of experience as a Data Engineer, with a focus on data lake architecture and ETL pipeline development.
- AWS Proficiency: Strong experience with AWS services including but not limited to S3, Glue, Lambda, Redshift, and IAM.
- ETL Expertise: Hands-on experience with Airbyte or similar ETL tools for data ingestion and transformation.
- Proficiency in Go: Experience writing services and connectors in Go, particularly for data pipeline automation.
- SQL and Data Modeling: Solid understanding of data modeling, SQL, and database concepts.
- Strong Scripting Skills: Familiarity with Python, Bash, or other scripting languages for automation and data manipulation.
- Data Governance and Security: Experience implementing security and governance best practices in cloud environments.
Preferred Skills:
- Containerization and Orchestration: Experience with Docker and Kubernetes is a plus.
- Knowledge of Data Analytics Tools: Familiarity with data analytics tools such as Tableau, Looker, or QuickSight.
- Experience with Data Warehouses: Familiarity with data warehouse solutions, particularly in the AWS ecosystem (e.g., Redshift, Athena).
Salary
N250,000 monthly.
Method of Application
Interested and qualified candidates should send their CV to: DataEngineer.joblagos@gmail.com using the Job Position as the subject of the mail.
Similar Jobs
- Structural Engineer - Compliance and Standardization Job at Kloverharris Limited
- Machine Engineer Job at ATS Travels
- Engineering Manager Job at StraitPay
- Civil Engineering Supervisor Job at Oilserv Limited
- Engineer, Software Job at Stanbic IBTC Bank
- Job Openings at Ponticelli Nigeria
- Technical Engineer Job at Amo Farm Sieberer Hatchery Limited
- Job Vacancies at Shell Petroleum Development Company
- Job Openings at Fit-Plus Health Studio Limited
- Structural Engineer Job at Domstaff Premier Service