Data Engineer (Financial Service)

Responsibilities

• Advise business about current state data architecture and data sources and create an appropriate transition path to cloud-based platform
• Work with stakeholders in order to understand the implementation of database requirements, analyze performance, and troubleshoot any existent issues
• Coordinate with stakeholders to gather and consolidate business/technical requirements for designing, developing and delivering the data solutions to business as the expected target
• Design and build large-scale enterprise data solutions and applications using one or more AZURE data and analytics services in combination with 3rd parties
• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala
• Design and implement data engineering, ingestion, and curation functions on AZURE cloud using AZURE native or custom programming
• Development, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and large-scale processing systems architectures

Qualifications

• Degree in Computer Engineering and Computer Science or equivalent experience
• Minimum 5 years of experience in full-life cycle development/implementation of enterprise data applications, big data technology, data analysis and system development
• Experience (intermediate) as practitioner in Cloud Platform; AZURE (preferrable), AWS and GCP
• Experience in selecting and integrating any Big Data tools and frameworks to meet required capabilities
• Experience in building cloud data pipelines from ingestion to consumption
• Experience in Python, R, Tableau, Hadoop, SQL
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts
• Strong stakeholder management with a collaborative, diplomatic, and flexible style, able to work effectively in a matrixed organization
• Excellent presentation skills, including strong oral and written capabilities in English
• Self-motivated, results-oriented individual with the ability to progress multiple priorities concurrently