Lead Apache Airflow Engineer

Quick Facts

• Lead development and maintenance of Airflow-based workflows
• Collaborate with cross-functional and distributed teams
• Mentor team members and coordinate technical delivery

Description

Lead the development and maintenance of Airflow-based workflows, driving technical delivery and mentoring team members while collaborating with cross-functional and distributed teams. You will build and enhance Airflow components (Operators, Hooks, Sensors), integrate new Airflow versions with Cloud Composer, and fix bugs to implement improvements. You will also add automated tests and maintain internal documentation for the work artifacts.

Responsibilities

• Develop new and maintain existing Apache Airflow Operators, Hooks, and Sensors
• Integrate new Airflow versions with Cloud Composer
• Fix bugs and implement improvements in Airflow workflows and components
• Implement testing for Airflow work (unit and solution/integration testing)
• Create and maintain internal documentation for work artifacts
• Coordinate development activities and support delivery planning within the team
• Collaborate with cross-functional and distributed teams to resolve technical issues
• Support junior engineers with knowledge sharing, technical guidance, and code reviews
• Participate in technical discussions with clients regarding prioritization and coordination

Requirements

• 7+ years of experience with strong Python programming skills
• Experience working with Cloud APIs (REST/RPC)
• Knowledge of DevOps/SysAdmin practices, Linux, and Kubernetes (including building container images)
• Understanding of cloud platforms, especially Google Cloud Platform
• Expertise in Apache Airflow or experience building workflows based on Luigi, Oozie, Argo, Azkaban, or Apache NiFi
• Experience contributing to open-source communities
• Proficiency in English communication (spoken and written)

Benefits

• Stable pay and Employee Stock Purchase Plan (15% discount)
• Benefits package (health insurance, multisport, shopping vouchers)
• Referral bonuses up to $2,000
• Growth opportunities: career development programs, mentoring, thought leadership, soft skills and well-being programs, and certifications (e.g., GCP, Azure, AWS, Gemini, Anthropic)
• English classes
• Hybrid-by-design with remote opportunity within Poland and chance to work abroad up to 60 days annually
• Business-driven relocation opportunities