Imaginary Cloud ir programmatūras izstrādes un UX/UI dizaina uzņēmums, kas darbojas SaaS, B2B un plašākos programmatūras izstrādes projektos. Kopš 2010. gada uzņēmuma komandas ir izstrādājušas, izveidojušas, ieviesušas un mērogojušas vairāk nekā 300 tīmekļa un mobilo lietotņu. Ar birojiem Portugālē un Apvienotajā Karalistē uzņēmums apvieno produktu izstrādi ar uz cilvēku vērstu pieeju tehnoloģijām un veido darba vidi, kuras pamatā ir cieņa, rūpes un nepārtraukta mācīšanās. Imaginary Cloud piedāvā arī attālinātā darba iespējas cilvēkiem, kuri vēlas sniegt ieguldījumu digitālo produktu izstrādē dizaina un inženierijas jomā.
Senior Data Engineer – Databricks and PySpark
Build Databricks and PySpark data workloads for Imaginary Cloud’s digital products. Improve analytics pipelines for global clients in a hybrid role based in Portugal.
Portugāle39 360 € – 60 600 € / gads
HibrīdiPilna slodzeVecākais speciālistsNepieciešamā Valoda: angļuDatu inženierisApraksts
- Build and manage data workloads in Databricks
- Develop data engineering solutions with PySpark and Delta Lake
- Write and tune SQL queries, including window functions and complex joins
- Create streaming or incremental data ingestion pipelines
- Apply idempotency, checkpointing, and schema evolution patterns
- Model data for business intelligence and analytics
- Test data and code with pipeline expectations, dbt tests, or similar tools
- Use Git, code reviews, linters, unit tests, and CI/CD pipelines
- Use agentic AI tools to speed up development, refactoring, and complex debugging
- Work with engineering and product development teams
- Contribute to digital products for global clients in multidisciplinary teams
Prasības
- Bring at least five years of experience in data engineering or a closely related role
- Have an academic background in computer science, data engineering, data science, or a related quantitative field
- Have hands-on production experience with Databricks
- Bring substantial experience building data workloads in Databricks
- Have a strong understanding of PySpark and Delta Lake
- Be proficient in SQL, including window functions, complex joins, and query tuning
- Have experience with streaming or incremental ingestion, including Structured Streaming or Auto Loader, plus idempotency, checkpointing, and schema evolution patterns
- Have experience modeling data for BI and analytics
- Understand testing and CI/CD for Databricks workflows
- Know software engineering and DevOps fundamentals, including Git, code review, linters, unit tests, and CI/CD pipelines
- Practice data quality testing with pipeline expectations, dbt tests, or similar methods
- Be highly proficient with agentic AI tools such as Cursor IDE and GitHub Copilot
- Bring strong analytical and problem-solving skills
- Have experience collaborating with engineering and product development teams
- Be fluent in spoken and written English
- Live in Portugal, or be willing and legally eligible to live and work there
Priekšrocības
- Salary based on experience and performance
- Paid sick days
- Health and dental insurance
- A comfort budget
- A remote-first company
- Flexible working hours
- Projects with global, industry-leading clients
- A people-focused culture that values and empowers its team
- An informal work environment
- Team events for sharing knowledge and celebrating together
- Mentoring and performance reviews to support career growth