Текст заказа
Rate: up to 170 pln/h net + VAT, B2B
Location: Hybrid - 2-3 days a week in office (Gdańsk)
Industry: Banking
Summary: This role focuses on enhancing the data platform by migrating existing systems to a modern infrastructure that integrates, processes, and delivers crucial financial data, fostering informed decision-making and reporting.
Responsibilities:
Migrate over 100 legacy ETL pipelines to an Airflow-on-Kubernetes platform.
Design, build, and maintain new data ingestion pipelines ensuring reliability and observability.
Collaborate with source-system teams to onboard and maintain financial data feeds.
Contribute to Snowflake transformation efforts, integrating DBT and Python data modeling.
Engage in CI/CD processes, testing, and data-quality practices to enhance tooling and procedures.
Influence technical direction and growth within an evolving platform and team environment.
Key Requirements:
Strong hands-on experience with Python.
Solid experience with Apache Airflow or similar orchestration tools.
Strong SQL skills.
Proven ETL/data pipeline development experience.
Experience with Git and standard version-control workflows.
Working knowledge of Snowflake or another major cloud data warehouse.
Understanding of data modeling fundamentals.
Comfortable working in a large, cross-team environment with multiple stakeholders.
Nice to Have:
Experience with DBT (Data Build Tool).
Familiarity with AI coding assistants like GitHub Copilot.
Experience with financial/banking data domains.
Exposure to Scala/Spark or Snowpark.
Experience with Kafka or similar streaming platforms.
Familiarity with CI/CD tooling such as Jenkins.
Prior experience with migration from legacy ETL tools to modern stacks.
Other Details:
Location: Remote or based in Gdańsk, Poland
Required language: English
Team Structure: Cross-functional collaboration with multiple stakeholders.