Sigma Software Group — 2002 жылы құрылған көпұлтты технологиялық консалтинг компаниясы. Оның командалары автомобиль жасау, денсаулық сақтау, телекоммуникациялар, авиация, банк ісі, ойын индустриясы, жылжымайтын мүлік және жарнама сияқты салалардағы клиенттерге бағдарламалық жасақтама әзірлеу, графикалық дизайн, тестілеу және техникалық қолдау қызметтерін көрсетеді. Компания күрделі инженерлік жобаларда жұмыс істеу үшін IT мамандарын жұмысқа қабылдайды және тәлімгерлік пен үздіксіз оқу арқылы кәсіби дамуды қолдайды. Қашықтан жұмыс істеу мүмкіндіктері компанияның жұмыс үлгісінің бір бөлігі болып табылады, ал жобалары AstraZeneca, Scania және SAS сияқты ұйымдарға қызмет көрсетеді.
Data Engineer (Azure, Spark) — Remote in Ukraine
Build scalable Azure data platforms and pipelines that support analytics, reporting, and data-informed decisions. Develop Spark workflows and dependable data processing in collaboration with multiple teams.
Сипаттама
- Build scalable, reliable data platforms and pipelines for analytical and operational needs.
- Create data processing workflows with distributed frameworks such as Apache Spark and PySpark on Databricks.
- Help advance the cloud data platform with Azure services, including Data Factory, Synapse, Microsoft Fabric, Databricks, Event Hub, and Azure Data Lake Storage.
- Integrate and process internal and external data while maintaining consistency, quality, and reliability.
- Own pipeline reliability, monitoring, and performance.
- Work with analysts, data scientists, and engineers to turn business and analytical needs into robust data solutions.
- Improve data engineering practices, including pipeline standards, testing, and operational reliability.
- Evaluate and help introduce tools and technologies for the data engineering environment.
Талаптар
- Bring at least four years of hands-on experience in data engineering or building data processing platforms.
- Use SQL confidently and have solid Python experience developing and maintaining data pipelines.
- Have experience with distributed processing frameworks such as Apache Spark or PySpark; Databricks experience is a strong advantage.
- Have practical experience designing and implementing cloud data pipelines, preferably on Azure.
- Have designed pipelines and data models for production-scale analytical systems.
- Understand ETL/ELT design, dimensional modeling, and data warehousing principles.
- Have experience with modern data lake architectures and formats such as Parquet and JSON.
- Have used workflow orchestration tools such as Airflow.
- Have experience with database development and performance optimization.
- Be able to design scalable, maintainable data solutions with minimal supervision.
- Communicate and collaborate effectively.
- Have professional working proficiency in English.
- Have experience with cloud data warehouses such as Snowflake, BigQuery, or Redshift.
- Have experience with streaming technologies such as Event Hub, Kafka, or Spark Streaming.
- Have experience with Delta Lake or other lakehouse technologies.
- Be familiar with CI/CD practices and Git-based development workflows.
- Have experience working in agile development environments.
Артықшылықтар
- Work remotely.