Data Resiliency Engineer - Data Lake

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from PayNet (Payments Network Malaysia) SUMMARY OF RESPONSIBILITIES As a Data Resiliency Engineer, you will be at the forefront of maintaining and enhancing the robustness of our data infrastructure. You will analyze issues to identify root causes and implement solutions that ensure a seamless user experience. Your expertise in data ecosystem monitoring, incident management, and data quality enhancement will play a pivotal role in maintaining operational excellence. You will utilize advanced tools like Datadog and Opsgenie to proactively monitor and resolve issues, act as a subject matter expert for data-related inquiries, and champion data quality initiatives. Additionally, you will work closely with the team to ensure our suite of payments reporting systems for participants as well as PayNet internal reports, are accurate and aligned with evolving organizational needs, driving continuous improvement in our data-driven operations. KEY AREAS OF RESPONSIBILITIES Root Cause Analysis & Bug Fixing: Analyze issues to uncover root causes and implement effective solutions, ensuring a smooth user experience. Data Ecosystem Monitoring: Oversee the data environment using advanced monitoring tools like Datadog, proactively identifying and addressing issues before they escalate. Alert System Management: Collaborate with the team managing Opsgenie and other alert systems, ensuring timely responses to critical incidents and maintaining operational excellence. Data Lake Support: Serve as the primary contact for data-related inquiries, including ETL incident management, reporting challenges, and providing actionable insights. Data Quality Monitoring: Own and enhance data quality monitoring tools, designing robust pipelines and frameworks to maintain the highest data integrity standards. Reporting Management: Lead report amendments and ensure reporting processes are accurate and meet the evolving needs of the organization. QUALIFICATIONS & EXPERIENCE Minimum Qualifications Bachelors degree in Computer Science, Engineering, Information Systems, or a related field. Strong experience with

AWS data services

(e.g., S3, Glue, Athena, Quicksight, Lambda). Strong experience in

Python

programming language Proficiency in

PySpark

for large-scale data processing. Familiarity with

workflow management tools

(e.g., Apache Airflow) Familiarity with operating data tools on

Kubernetes

and

EKS Expertise in

monitoring tools

(e.g., Datadog, CloudWatch) to proactively track and resolve issues. Experience with

alert management systems

like

Opsgenie

or similar platforms. Strong understanding of

data lakes

and managing large-scale data environments. Experience in performing

root cause analysis

for complex data issues and implementing effective bug fixes. Terraform or other IaC tools for infrastructure provisioning Relevant certifications in AWS and data engineering PERSONAL QUALITIES Self-motivated problem solver who can work with minimal guidance Excellent communication skills to articulate technical details clearly to non-technical stakeholders. Detail-oriented with a focus on data quality and reliability Proven ability to work cross-functionally with multiple teams (e.g., Data Engineering, Operations, Analytics). Passionate engineer looking to learn new technologies Seniority level

Seniority level Mid-Senior level Employment type

Employment type Contract Job function

Job function Information Technology Referrals increase your chances of interviewing at PayNet (Payments Network Malaysia) by 2x Sign in to set job alerts for “Data Engineer” roles.

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Data Analyst - SG Business Intelligence (Open for fresh graduates)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Petaling Street, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Junior Data Engineer (Recent graduates are encouraged to apply)

Federal Territory of Kuala Lumpur, Malaysia 1 week ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Federal Territory of Kuala Lumpur, Malaysia 6 days ago Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Data Engineer/ Python Developer - Data Lake

Federal Territory of Kuala Lumpur, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Federal Territory of Kuala Lumpur, Malaysia 2 hours ago Federal Territory of Kuala Lumpur, Malaysia 2 days ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,500.00-MYR4,000.00 1 month ago Federal Territory of Kuala Lumpur, Malaysia 19 hours ago Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Information :

• Company : PayNet (Payments Network Malaysia)
• Position : Data Resiliency Engineer - Data Lake
• Location : Kuala Lumpur, Kuala Lumpur
• Country : MY