
Blend360 yra profesionalių paslaugų įmonė, padedanti „Fortune 1000“ įmonėms ir kitoms didelėms organizacijoms spręsti sudėtingus verslo iššūkius pasitelkiant dirbtinį intelektą, duomenų analitiką ir duomenimis grindžiamus sprendimus. Įmonės veikla apima verslo analitiką, duomenų inžineriją, duomenų mokslą, MLOps ir duomenų valdymą. Blend360 telkia specializuotas komandas ir dirbtinio intelekto galimybes, kad padėtų organizacijoms sveikatos priežiūros, finansinių paslaugų, energetikos, mažmeninės prekybos, technologijų, žiniasklaidos ir telekomunikacijų bei kelionių ir svetingumo sektoriuose. Blend360 veikla įvertinta, be kita ko, apdovanojimu „AI-Enabling Solution of the Year“, o įmonė įtraukta į 2024 m. geriausių generatyvinio dirbtinio intelekto paslaugų teikėjų sąrašą.
Remote Data Engineer Analyst — AWS and Spark
Build scalable AWS data pipelines and lake architectures for Blend360, an AI services provider. Develop Spark-based processing and dependable data solutions for global clients.
Aprašymas
- Build and maintain scalable data pipelines and ingestion frameworks.
- Support batch, streaming, and change data capture (CDC) processing.
- Create and optimize data workflows with Apache Spark and PySpark.
- Implement and manage AWS data lakes using Amazon S3 and Apache Iceberg.
- Orchestrate ETL with AWS Glue and use Athena for serverless queries and Lambda for event-driven processing.
- Configure data access controls and security with AWS IAM.
- Work with analysts, data scientists, and platform engineers to clarify needs and deliver production-ready solutions.
- Monitor pipeline health and resolve data quality issues.
- Improve data reliability and freshness.
- Document data flows, architecture decisions, and engineering standards.
Reikalavimai
- Bring advanced, hands-on experience with AWS services such as Glue, S3, Athena, and IAM.
- Have experience processing data with Apache Spark and PySpark.
- Understand data lake architectures; Apache Iceberg experience is preferred.
- Have experience with batch, streaming, and change data capture (CDC) ingestion patterns.
- Use SQL for querying, validation, and exploratory analysis.
- Understand data modeling and large-scale data processing.
- Work effectively with cross-functional teams.
- Explain technical concepts clearly to non-technical stakeholders.
- Experience with infrastructure as code or orchestration tools such as Airflow, Step Functions, or dbt is a plus.
- Be familiar with AI-assisted development workflows and engineering productivity tools.
- Have advanced English skills for communication with global teams.
- Have at least two years of experience in data engineering or a related role.
- Have hands-on experience building and maintaining cloud data pipelines and AWS lake architectures.
Privalumai
- Daily headquarters lunches include vegetarian, vegan, gluten-free, and sugar-free options.
- Enjoy gourmet Friday meals prepared by an on-site chef at headquarters.
- Flexible working options are available.
- A MacBook and accessories are provided.
- Snacks and beverages are available daily at headquarters.
- Headquarters hosts after-work events, football, tennis, and game nights.
- Join the football league on Wednesdays and Fridays.
- Take part in pool games and office trophy competitions.
- Tennis courts are available for friendly matches.
- Chess championships, game nights, and music nights are offered.
- Access AWS certification support, study plans, courses, and other certifications.
- English lessons are available.
- Take part in peer learning through Tech Tuesdays.
- Mentoring and development opportunities are available.
- Receive anniversary and birthday gifts.
- Work in a convenient location with a strong team.
Susiję darbai
Darbo pasiūlymų nerasta
Pabandykite pakeisti arba išvalyti filtrus, kad rastumėte daugiau galimybių.