Data Engineer Job at Revent Technologies Limited

Revent Technologies Limited is a technology solutions provider for dynamic organizations, providing bespoke software design and development, developer outsourcing and technology advisory, etc.

We are recruiting to fill the following positions below:

Job Position: Data Engineer

Job Location: Lagos
Employment Type: Full Time

Job Description


  • As a Data Engineer, you will be accountable for designing, developing and deploying ETL jobs to process petabytes of data through our big data platform, to enable analytics initiatives and data science.
  • You will be passionate about big data, working daily on data extraction, load and transformation in big data environments to ensure the successful, on-time, delivery of high-quality data.

Responsibilities

  • Design and develop ETL jobs in big data environments to process petabytes of data.
  • Build reusable frameworks or jobs which can be used in different projects.
  • Developing code to automate jobs using real-time services, and flexible coding to remove dependencies.
  • Manage Data Services and Data Quality transformations using SQL: Analyzing redundant and inconsistent data.
  • Own continuous improvement and performance testing: Document ETL-related issues and perform RCA, identify long-running jobs and optimization opportunities.

Qualifications

  • BA/BS in Computer Science, Computer Engineering. Engineering, Statistics/Mathematics or similar
  • 3 - 4 years of experience
  • Development experience in EITHER: Talend Big Data Edition on Hadoop or BODS
  • Experience in connecting to heterogeneous sources including SAP ECC, Hadoop, Hive, Amazon, Azure, Salesforce, SAP among others
  • Experience with multiple file formats and file location objects including SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3
  • Good understanding of HDInsight cluster, Microsoft SQL Servers as well as RDBMS databases & No-SQL databases
  • Hands-on experience in ETL design, source-target mapping, developing and performance tuning complex ETL code
  • Experience with Infrastructure automation, build automation and deployment automation
  • Experience in working with GIT, SVN or VSTS
  • Knowledge of Slowly Changing Dimensions, ABAP Data flow Extractions, Star Schema, Snowflake Schema, OLTP and OLAP
  • Hands on experience of cloud platforms, especially Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP)
  • Proficient in English, other languages beneficial

Competencies

  • A true self-starter, who dreams big, and is motivated by a challenging and fast-paced environment
  • Ability to manage conflicting priorities under pressure
  • Strong relationship management, communication and collaboration skills: effectively working with technical audiences.

Method of Application
Interested and qualified candidates should send their CV to: %20hr@reventtechnologies.com using the Job Position as the subject of the mail.