Data Engineer

Job Description

  • Design, develop, and maintain highly scalable data infrastructure.
  • Design data warehouse/data mart and implement appropriate data models depending on different data use cases.
  • Design, develop, and maintain a single source of truth for key business metrics.
  • Ensure standardized metadata, access protocols, and discovery mechanisms.
  • Act as a subject matter expert for data architecture, data modelling, solution design, and best practices within the Data Team.
  • Develop a good understanding of the Business with its various domains and understand data use cases across different functions.
  • Build data quality checks and ensure quality of data products, including timeliness, consistency, performance, and accuracy.
  • Collaborate with the Engineering department on data governance/security standards and ensure that data products meet those standards.
  • Monitor data collection, storage and retrieval processes.
  • Explore and integrate appropriate new big data technologies into current infrastructure.

Qualifications

  • At least 3 years of experience working in data engineering, data architecture, data modelling, master data management, or similar.
  • In-depth understanding of data pipelines (ETL/ELT), database structure principles, data warehousing techniques, data mining concepts, and segmentation techniques.
  • Experience in designing and implementing data lake, data warehouse and data mart.
  • Experience in database performance tuning.
  • Hands-on experience in SQL and Python.
  • Passionate and knowledgeable about big data stacks.
  • Distributed systems: Spark, Hadoop, Presto, Hive, etc.
  • Message Queuing systems: Kafka, etc.
  • Database (Relational & NoSQL): PostgreSQL, MySQL, Cassandra, etc.
  • Workflow Orchestrator: Airflow, etc.
  • Business Intelligence Tool: Looker, Tableau, etc.
  • Experience gathering and analyzing both system and business requirements.
  • Experience with cloud computing platforms (AWS, AliCloud, GCP, or others) and UNIX environment.
  • Have fast learning capability and natural curiosity about big data.

Join us by fill in this Job Application Form:

Click Here to Apply this Position