Senior ETL Developer

Quick Facts

• Role: Senior ETL Developer
• Focus: High-performance ETL data platforms for real-time FX market data
• Scale: Up to 40 million messages daily

Description

Design, develop, and maintain high-performance data platforms that support analysis processes for FX. Build and optimize ETL pipelines and database performance using PostgreSQL and Python in a real-time architecture. Contribute to an enterprise-class platform supporting many currency pairs with high availability and scalability.

Responsibilities

• Design and develop high-performance data platforms using PostgreSQL and Python
• Maintain and optimize database performance for large data volumes
• Implement ETL processes for efficient data integration and transformation
• Collaborate with cross-functional teams for real-time data access and processing
• Monitor system performance and apply adjustments for scalability
• Create and manage database models, including normalization and denormalization
• Use PL/pgSQL to build procedures, functions, and triggers
• Ensure data integrity and implement archiving strategies for data retention

Requirements

• Minimum 5 years of experience working with PostgreSQL
• Strong command of SQL and data modeling techniques
• Hands-on mastery of PL/pgSQL, including procedures and triggers
• Practical experience with database performance tuning and optimization
• Experience in ETL integration and working with large data volumes
• Familiarity with the Linux environment
• Advanced level of Polish and English
• Residency in Poland

Nice-to-have

• Experience with Apache Kafka or RabbitMQ
• Knowledge of Apache Airflow and CI/CD practices
• Background in the banking or financial sector