The Senior Software Engineer – Data Warehouse (ELT) is responsible for designing, developing, and maintaining efficient data pipelines and processes within a data warehouse environment. This role is critical in managing data transformations, ensuring high data quality, and enabling effective data utilization across the organization. As a Senior Software Engineer, you will work closely with data analysts, data scientists, and other stakeholders to build scalable ELT solutions that support business intelligence, reporting, and advanced analytics.
| Salary | Market Competitive |
| Experience | 5 – 8 Years |
| Location | Dubai |
| Qualification | Bachelors in Computer Application, Bachelor of Technology/Engineering(Computers), Bachelor of Science, Any Graduation |
| Posted | 30 October 2024 |
| Job Type | Full-Time |
| Posted by | Habeebi Recruiter |
| last date to apply | apply within 15 days |
Key Responsibilities
- ELT Pipeline Development and Optimization
The Senior Software Engineer will be responsible for creating and managing ELT (Extract, Load, Transform) pipelines that move data from source systems to the data warehouse. This includes extracting data from various databases, performing necessary transformations, and optimizing load processes. With a strong focus on scalability and efficiency, the engineer will ensure that data is available for analytics and reporting in a timely manner. - Data Modeling and Architecture
Designing and implementing effective data models is a key responsibility in this role. The Senior Software Engineer will create and maintain logical and physical data models that support ELT operations, ensure data accuracy, and meet business needs. Additionally, they will work on architecting data flows, establishing data schema structures, and developing best practices to streamline data storage and retrieval. - Performance Tuning and Troubleshooting
To maintain optimal performance, the Senior Software Engineer is responsible for fine-tuning data pipelines, SQL queries, and transformations. They will proactively monitor ETL jobs, resolve bottlenecks, and handle any data-related issues that arise. In-depth troubleshooting capabilities and a keen understanding of data warehouse infrastructure are essential for addressing and minimizing downtime. - Data Quality and Integrity Assurance
Data quality is paramount, and the Senior Software Engineer ensures data integrity by establishing validation procedures, error-handling protocols, and implementing automated data quality checks. By collaborating with data governance teams, they will also assist in maintaining data compliance and uphold data standards across various datasets, ensuring trustworthiness and usability for downstream consumers. - Collaboration with Cross-Functional Teams
The role requires close collaboration with data analysts, business intelligence teams, and other software engineers to align data infrastructure with business goals. The Senior Software Engineer will communicate technical insights, gather requirements, and provide data solutions that support analytics initiatives, driving a cohesive approach to data-driven decision-making. - Documentation and Knowledge Sharing
Creating and maintaining detailed documentation for ELT processes, data models, and architectural decisions is an important aspect of this role. The Senior Software Engineer will document best practices, data transformations, and troubleshooting guidelines to facilitate team collaboration and ensure consistent knowledge sharing. This helps foster a well-documented data environment, accessible and understandable to all relevant stakeholders.
Qualifications and Skills
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field
- 5+ years of experience in data engineering, with a focus on ELT development in a data warehouse environment
- Proficiency in SQL and hands-on experience with data warehousing tools (e.g., Snowflake, Redshift, BigQuery)
- Experience with ELT tools such as dbt, Talend, or Apache NiFi
- Strong understanding of data modeling and data architecture principles
- Excellent problem-solving skills and experience with performance tuning in data systems
- Ability to work collaboratively with cross-functional teams and communicate complex technical concepts clearly
How to apply:
Send your updated resume to our email or directly reach us at our phone:
Email: info@triacitsolutions.com
Phone: + 971-54 510 3704
Fax: + 971 (0) 45754857