Senior Data Engineer at Sigma Software

ABOUT THE PROJECT

The project focuses on building and maintaining large-scale cloud-based data infrastructure for healthcare applications. It involves designing efficient data pipelines, creating self-service tools, and implementing microservices to simplify complex processes.

REQUIREMENTS

– Hands-on experience with cloud computing services in data and analytics
– Experience with data modeling, reporting tools, data governance, and data warehousing
– Proficiency in Python and PySpark for distributed data processing
– Experience with Azure, Snowflake, and Databricks
– Experience with Docker and Kubernetes
– Knowledge of infrastructure as code (Terraform)
– Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
– Experience with stream processing technologies such as Kafka, Spark Structured Streaming
– At least an Upper-Intermediate level of English

RESPONSIBILITIES

– Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
– Build and maintain infrastructure using Terraform for cloud platforms
– Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
– Work with large datasets to optimize performance and ensure seamless data integration
– Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
– Discover, analyze, and organize disparate data sources into clean, understandable schemas

WHAT WE OFFER

– Diversity of Domains & Businesses
– Variety of technology
– Health & Legal support
– Active professional community
– Continuous education and growing
– Flexible schedule
– Remote work
– Outstanding offices (if you choose it)
– Sports and community activities

COMPENSATION & BENEFITS

–