Data Engineer

Long Description

Job Summary

Data integration, unification, cleansing and data quality management

Job Responsibilities

Management of data inflow

• Create and maintain optimal data pipeline architecture; adopt new technologies to improve existing frameworks of data flow and monitoring
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies; take necessary steps to implement necessary changes in the IT infrastructure such as MDM tool acquisition, data lake design, cloud solutions implementation in coordination with IT and technology coordinator
• Create data tools for analytics and data scientist team members that assist them in building models by automating and simplifying data preparation
• Translate customer data strategy into actionable data integration plans and execute these plans
• Maintain 360 degree view of customer, enhance the customer datamarts by continuously integrating new sources of data

Data cleansing and unification

• Create automated data anomaly detection systems and constant tracking of its performance
• Process, cleanse, and verify integrity of data used for analysis; active use of built-in data quality dashboard on CDP and coordination of corrective actions
• Develop algorithms to de-duplicate and export customer data from multiple BUs to ensure data unification
• Ensure continuous unification of customer records and associated profile and transactional data

Candidate Requirements

Education