Текст заказа
Data Engineer (Databricks, Azure)
Компания: MW Consulting
Город: Wrocław
Удалённо
We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland. Avanade website; Privacy policy This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow). Position: As Data Engineer, you will be working in projects for various domains and industries, with tech stack focused mostly around Databricks and Azure cloud. Among your tasks there will be: Designing, building, and maintaining scalable, efficient, and reliable data pipelines Developing data architectures and ETL processes end to end Collaborating with data scientists, analysts, and engineering teams to ensure effective data integration and optimization Applying best engineering practices across data solutions Optimizing data workflows and ensuring the reliability and performance of data systems (for Senior level) Taking on a Team Lead role within a project when needed Developing your skills in AI Engineering and exploring opportunities in this area Required skills: For this role, we require commercial experience with: Databricks Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks) Python and PySpark SQL Data Engineering concepts such as ETL, data modeling, medallion architecture, data warehousing, data governance Terraform English (at least B2) Nice to have: Docker and Kubernetes Knowledge of OCR and corresponding libraries (e.g. easyOCR) Any experience in data science area If you want to ask any questions before applying, feel free to reach out via LinkedIn!