
Senior Data Software Engineer (Azure, Spark)
EPAM Systems
Gdańsk, Pom, Poland • 1h ago • On-site
Senior
On-site
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Quick Facts
Senior Data Software Engineer (Azure, Spark)
Description
Senior Data Software Engineer role designing and building a modern Azure-based enterprise data platform for large-scale financial data processing using medallion architecture. You will lead ingestion, transformation, storage, and near real-time analytics with strong focus on data quality, governance, and performance. Mentoring and CI/CD automation for data pipelines are key parts of the position.
Responsibilities
- Lead design, development, and optimization of scalable data engineering solutions on Azure using Spark-based processing (PySpark, SparkSQL, Scala, or equivalent)
- Own end-to-end data transformation pipelines: ingestion, transformation, storage, and analytics
- Work with Azure-native data services such as Data Factory, Databricks, and Synapse
- Support high-performance data access patterns using Cosmos DB (NoSQL API) where applicable
- Collaborate with data scientists, AI engineers, and product stakeholders to enable data-driven analytics and insights
- Mentor and guide junior engineers, setting coding standards and best practices
- Ensure data quality, security, governance, and performance across platforms
- Contribute to technical decision-making and solution architecture discussions
- Build and maintain data pipelines within a medallion architecture supporting structured and complex datasets
- Apply CI/CD practices to automate validation and deployment of data pipelines
Requirements
- 5+ years of experience in data engineering focused on large-scale data processing
- Proficiency in Microsoft Fabric, Apache Spark, and Python
- Skills in Pandas, Delta Lake, and Parquet for data processing, storage, and optimization
- Knowledge of Cosmos DB for bitemporal data storage and retrieval
- Familiarity with AWS Glue for supporting ETL workflows
- Expertise in Spark Streaming for near real-time processing with watermarking support
- Competency in CI/CD tools for building automated validation pipelines
- Background mentoring engineers and establishing coding standards and best practices
- English proficiency at B2 level or higher
Benefits
- Hybrid-by-design with opportunity to work remotely within Poland; chance to work abroad up to 60 days annually
- Business-driven relocation opportunities
- Career development programs; thought leadership, mentoring, soft skills and well-being programs
- Certifications (Anthropic, Gemini, GCP, Azure, AWS)
- English classes
- Stable pay; Employee Stock Purchase Plan with a 15% discount
- Benefits package (health insurance, multisport, shopping vouchers)
- Referral bonuses up to $2,000
- Office perks (entertainment and relaxation zones, table tennis and football, free snacks, coffee)
- Corporate, social and well-being events
- Contractors may be considered; B2B terms agreed individually (benefits listed are for employees only)
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior AI Data Software Engineer
EPAM Systems
Senior
Technology
Lodz, Poland · Remote
N/A
15 days ago

Senior AI Data Software Engineer
EPAM Systems
Senior
Technology
Poznań, Pl-30, Poland · Remote
N/A
15 days ago

Senior Data Engineer (Java/Scala/Python, Spark, AWS)
EPAM Systems
Senior
Technology
Warsaw, Poland · On-site
N/A
1h ago

Senior AI Data Software Engineer
EPAM Systems
Senior
Technology
Katowice, Silesia, Poland · Remote
N/A
15 days ago
Senior Data Engineer
CLOUDFIDE SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Senior
Technology
Warsaw, MA, Poland · Remote
N/A
13 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior AI Data Software Engineer
EPAM Systems
Senior
Technology
Wrocław, Poland · Remote
N/A
15 days ago

Senior Cloud Data Engineer (Azure)
Future Processing
Senior
Technology
Gliwice, Poland · Remote
N/A
14 days ago

Senior Data Engineer
Clurgo
Senior
Technology
Warsaw, Poland · Remote
N/A
16 days ago

Senior AI Data Software Engineer
EPAM Systems
Senior
Technology
Krakow, Poland · Remote
N/A
15 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights