Descrição da Função

We’re seeking for a Mid Data Platform Engineer to join an innovative and International project. Responsibilities: • We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider, Galp. • Provide user support for the data platform, troubleshooting and fixing issues • Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows • Collaborate with platform architects to ensure the data platform is efficient, secure, and highly available • Improve data processes, monitoring, performance and platform efficiency • Support data quality frameworks and monitoring to ensure accuracy, consistency, and completeness of data pipelines • Support for data lakes, data warehouses, and data streaming solutions • Work with stakeholders (data scientists, analysts, business users) to solve issues in the data platform • Automate repeatable tasks and improve the data ingestion, transformation, and delivery processes • Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency • Document data platform changes, processes, and best practices • Review, evaluate and approve data product releases to production. Requirements: • Experience with data pipelines in a production environment • Strong hands-on knowledge of SQL and experience with distributed data processing (e.g., Apache Spark) • Proficiency and knowledge of troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi and Apache AirFlow • Proficiency in a programming language such as Python or Scala for data engineering tasks • Experience with cloud data services (AWS) • Familiarity with Grafana tools • Knowledge of data governance, security, and compliance in a cloud environment • Experience implementing CI/CD and testing frameworks for data workflows • Strong problem-solving skills, communication skills, and passion for collaboration • Fluent in written and spoken Portuguese and English. What will be a plus: • Familiarity with Dremio data lake warehouse architectures and concepts • Experience with Terraform provisioning data services • Familiarity with Power BI on-premises gateway • Hands-on experience with data catalogue and governance tools (e.g., Collibra, Alation) • Experience with machine learning pipelines and feature engineering Regime: Remote from Portugal (the candidate can work remotely from any Portuguese region) What we offer: • 26 days of vacation • health insurance • 50€ as a birthday bonus • Training • Opportunity to develop your career Take the Leap, Join Us!

Localização

• Todo o país, Portugal