Databricks Data Engineer
Descrição da Empresa
A Olisipo é uma das principais e mais sólidas referências nacionais como talent recruiter, talent builder e talent care na área das tecnologias de informação. A nossa missão é encontrar o melhor projeto para cada pessoa e, para cada empresa, o melhor talento na área das tecnologias de informação. #ConnectingITPeople
Descrição da Função
Profile: - At least 4 to 5 years of professional experience in data engineering or similar roles; - Hands-on experience with Databricks (essential); - Solid experience in data engineering, including the development and optimisation of data pipelines in layered/Data Lake architectures; - Experience with data governance practices, in particular the implementation or management of data catalogues and data lineage; - Experience with Data Vault would be an advantage; - Knowledge of data architectures and data transformation processes; - Experience with Azure Synapse or in data engineering platform migration projects would be an advantage; - Knowledge of Databricks’ AI/ML capabilities will be considered an asset; - Good knowledge of English (essential); - Strong analytical, problem-solving and teamwork skills. Responsibilities: - Support the migration of the existing data engineering architecture from Azure Synapse to Databricks; - Develop, optimise and maintain data transformation pipelines within data lake architectures; - Work with the different layers of the Data Vault architecture: Bronze, Silver and Gold; - Contribute to the adoption and development of Databricks capabilities within the Data e Analytics team; - Implement and optimise data transformation and integration processes; - Integrate data governance practices into the development of the new architecture; - Support the implementation and management of data catalogue and data lineage capabilities; - Collaborate with the technical team to define and implement robust, scalable and efficient solutions; - Contribute to the continuous improvement of data engineering processes and practices. We offer: - Health insurance; - Free online training through the Udemy platform; - On-site and remote training at Olisipo's Learning Center; - Free certifications (after passing the exam); - Discounts at Olisipo Partners (in the areas of health and well-being, fitness, travel, among others); - Free psychological consultations; - Possibility of a salary advance, without commissions.
Localização
- Lisboa, Portugal