
Blend360 ir profesionālo pakalpojumu uzņēmums, kas palīdz Fortune 1000 uzņēmumiem un citām lielām organizācijām risināt sarežģītus uzņēmējdarbības izaicinājumus, izmantojot mākslīgo intelektu, datu analītiku un uz datiem balstītus risinājumus. Uzņēmuma darbība aptver biznesa inteliģenci, datu inženieriju, datu zinātni, MLOps un datu pārvaldību. Blend360 apvieno specializētas komandas un mākslīgā intelekta iespējas, lai atbalstītu organizācijas veselības aprūpes, finanšu pakalpojumu, enerģētikas, mazumtirdzniecības, tehnoloģiju, mediju un telekomunikāciju, kā arī ceļošanas un viesmīlības nozarēs. Blend360 darbs ir saņēmis atzinību, tostarp balvu “AI-Enabling Solution of the Year”, un uzņēmums ir iekļauts 2024. gada labāko ģeneratīvā mākslīgā intelekta pakalpojumu sniedzēju vidū.
Remote Data Engineer Analyst — AWS and Spark
Build scalable AWS data pipelines and lake architectures for Blend360, an AI services provider. Develop Spark-based processing and dependable data solutions for global clients.
Apraksts
- Build and maintain scalable data pipelines and ingestion frameworks.
- Support batch, streaming, and change data capture (CDC) processing.
- Create and optimize data workflows with Apache Spark and PySpark.
- Implement and manage AWS data lakes using Amazon S3 and Apache Iceberg.
- Orchestrate ETL with AWS Glue and use Athena for serverless queries and Lambda for event-driven processing.
- Configure data access controls and security with AWS IAM.
- Work with analysts, data scientists, and platform engineers to clarify needs and deliver production-ready solutions.
- Monitor pipeline health and resolve data quality issues.
- Improve data reliability and freshness.
- Document data flows, architecture decisions, and engineering standards.
Prasības
- Bring advanced, hands-on experience with AWS services such as Glue, S3, Athena, and IAM.
- Have experience processing data with Apache Spark and PySpark.
- Understand data lake architectures; Apache Iceberg experience is preferred.
- Have experience with batch, streaming, and change data capture (CDC) ingestion patterns.
- Use SQL for querying, validation, and exploratory analysis.
- Understand data modeling and large-scale data processing.
- Work effectively with cross-functional teams.
- Explain technical concepts clearly to non-technical stakeholders.
- Experience with infrastructure as code or orchestration tools such as Airflow, Step Functions, or dbt is a plus.
- Be familiar with AI-assisted development workflows and engineering productivity tools.
- Have advanced English skills for communication with global teams.
- Have at least two years of experience in data engineering or a related role.
- Have hands-on experience building and maintaining cloud data pipelines and AWS lake architectures.
Priekšrocības
- Daily headquarters lunches include vegetarian, vegan, gluten-free, and sugar-free options.
- Enjoy gourmet Friday meals prepared by an on-site chef at headquarters.
- Flexible working options are available.
- A MacBook and accessories are provided.
- Snacks and beverages are available daily at headquarters.
- Headquarters hosts after-work events, football, tennis, and game nights.
- Join the football league on Wednesdays and Fridays.
- Take part in pool games and office trophy competitions.
- Tennis courts are available for friendly matches.
- Chess championships, game nights, and music nights are offered.
- Access AWS certification support, study plans, courses, and other certifications.
- English lessons are available.
- Take part in peer learning through Tech Tuesdays.
- Mentoring and development opportunities are available.
- Receive anniversary and birthday gifts.
- Work in a convenient location with a strong team.
Saistītās vakances
Nav atrasts neviens darbs
Mēģiniet pielāgot vai notīrīt filtrus, lai atrastu vairāk iespēju.