Data Engineer

Data Engineer

Black Pearl
3-6 years
Not Specified

Job Description


Our client who is a global trading platform is looking to hire a Data Engineer for their offices in Dubai.
Responsibilities
  • Gather and address technical and design requirements.
  • Architect our data platform & develop real-time apps ingesting large volume of data and processing messages real-time.
  • Handle all our data pipeline and contribute towards our data strategy and its execution.
  • Architecting, building, testing & managing our data platform infrastructure from data collection all the way to data processing & data storage.
  • Develop, customize and manage integration tools, monitoring tools, databases, warehouses, and analytical systems.
  • Support the developers through training and transfer of knowledge.
  • Participate in the entire application life-cycle mainly focusing on coding, debugging, and testing.

Requirements
Requirements
  • BSc degree in Computer Science/Computer Engineering. Masters is a plus.
  • Strong competencies in algorithms and software architecture.
  • 3+ years of experience in Python.
  • 2+ years of experience as a Data Engineer.
  • Strong experience in real-time data processing and data ingestion.
  • Strong experience in batch data processing and data pipelines.
  • Strong work experience in AWS Kinesis Services and building apps utilizing it is a must.
  • 3+ years of experience in developing APIs (REST & SOAP protocols).
  • 2+ years of experience in using AWS cloud and its resources/services.
  • Strong experience in Relational Databases (MySQL, SQL Server or PostgreSQL) and non-relational databases (Mongo DB or Cassandra. etc.)
  • Strong knowledge in Continuous Integration & Continuous Deployment (CI/CD) utilizing Docker containers.
  • Strong knowledge in Pandas & NumPy libraries is a big plus.
  • Strong knowledge in workflow orchestration tools (Airflow …etc.) is a plus.
  • Experience in Java is a plus.
  • Previous experience in automated testing including unit testing & UI testing is a plus.
  • Strong in-depth understanding of the entire web development process (design, development, and deployment)
  • Excellent analytical, time management and teamwork skills.

To view other vacancies we have, please visit our website -
Disclaimer: Black Pearl will never ask for money or any form to charge our candidates just to process or consider their application for any of our available vacancies. If you happen to receive such request from any members of our staff or other individuals claiming to be part of Black Pearl, please do call our office at +9712 622 55 03 or drop us a message on our website - .

Job Details

Employment Types:

Industry:

Other

Function:

IT

Similar Jobs

People Also Considered

Data Not Available

Career Advice to Find Better

Simple body text this will replace with orginal content