
Blend360 is a professional services company that helps Fortune 1000 and other large enterprises address complex business challenges through artificial intelligence, data analytics, and data-driven solutions. Its work spans business intelligence, data engineering, data science, MLOps, and data governance, bringing together specialist teams and AI capabilities to support organizations across healthcare, financial services, energy, retail, technology, media and telecommunications, and travel and hospitality. Blend360’s work has received recognition including “AI-Enabling Solution of the Year” and inclusion among the “Top Generative AI Service Providers 2024.”
Remote Data Engineer Analyst — AWS and Spark
Build scalable AWS data pipelines and lake architectures for Blend360, an AI services provider. Develop Spark-based processing and dependable data solutions for global clients.
Description
- Build and maintain scalable data pipelines and ingestion frameworks.
- Support batch, streaming, and change data capture (CDC) processing.
- Create and optimize data workflows with Apache Spark and PySpark.
- Implement and manage AWS data lakes using Amazon S3 and Apache Iceberg.
- Orchestrate ETL with AWS Glue and use Athena for serverless queries and Lambda for event-driven processing.
- Configure data access controls and security with AWS IAM.
- Work with analysts, data scientists, and platform engineers to clarify needs and deliver production-ready solutions.
- Monitor pipeline health and resolve data quality issues.
- Improve data reliability and freshness.
- Document data flows, architecture decisions, and engineering standards.
Requirements
- Bring advanced, hands-on experience with AWS services such as Glue, S3, Athena, and IAM.
- Have experience processing data with Apache Spark and PySpark.
- Understand data lake architectures; Apache Iceberg experience is preferred.
- Have experience with batch, streaming, and change data capture (CDC) ingestion patterns.
- Use SQL for querying, validation, and exploratory analysis.
- Understand data modeling and large-scale data processing.
- Work effectively with cross-functional teams.
- Explain technical concepts clearly to non-technical stakeholders.
- Experience with infrastructure as code or orchestration tools such as Airflow, Step Functions, or dbt is a plus.
- Be familiar with AI-assisted development workflows and engineering productivity tools.
- Have advanced English skills for communication with global teams.
- Have at least two years of experience in data engineering or a related role.
- Have hands-on experience building and maintaining cloud data pipelines and AWS lake architectures.
Benefits
- Daily headquarters lunches include vegetarian, vegan, gluten-free, and sugar-free options.
- Enjoy gourmet Friday meals prepared by an on-site chef at headquarters.
- Flexible working options are available.
- A MacBook and accessories are provided.
- Snacks and beverages are available daily at headquarters.
- Headquarters hosts after-work events, football, tennis, and game nights.
- Join the football league on Wednesdays and Fridays.
- Take part in pool games and office trophy competitions.
- Tennis courts are available for friendly matches.
- Chess championships, game nights, and music nights are offered.
- Access AWS certification support, study plans, courses, and other certifications.
- English lessons are available.
- Take part in peer learning through Tech Tuesdays.
- Mentoring and development opportunities are available.
- Receive anniversary and birthday gifts.
- Work in a convenient location with a strong team.
Related Jobs
No jobs found
Try adjusting or clearing your filters to find more opportunities.