|
Design, develop and optimized ETL/ELT pipelines: -
· Utilized Talend to create efficient data work flow that caters to organizational needs end-to-end ETL processes using Talend Open Studio or Talend Data Integration tools.
Data Management: -
· Implement data Extraction, transformation, and loading process from a wide variety of source systems (e.g., SQL,oracle, flat files, APIs, cloud services).
· Should be able to transform structure /unstructured data into logical model
Data Quality Assurance: -
· Ensure data accuracy, integrity and performance during large scale integrations
· Ensure data integrity, quality, and compliance with governance standards.
Performance Tuning: -
· Optimize Talend jobs for performance and scalability.
· Monitor and troubleshoot existing ETL jobs and resolve issues in a timely manner.
- Implement best practices for data quality, logging, and error handling.
- Handle production support and debugging of Talend jobs and workflows.
Collaboration:
· Collaborate with business analysts, other data engineers, and stakeholders to gather requirements and deliver high-quality data solutions.
· Maintain detailed documentation for all ETL processes and data flows.
Document data mappings, workflows, and transformation logic
|