Bitful este o firmă de consultanță tehnologică ce colaborează cu organizații din telecomunicații, administrație publică, apărare, logistică și sănătate. Serviciile sale includ infrastructură cloud, consultanță în analiza datelor, precum și proiectarea și dezvoltarea de software personalizat. Compania își descrie abordarea ca fiind centrată pe oameni, cu accent pe extinderea accesului la tehnologie și crearea de oportunități în comunitățile insuficient deservite. Bitful împarte, de asemenea, profiturile și contribuie cu o parte din acestea la programe de mentorat în tehnologie.
Senior Data Engineer, Databricks
Build Databricks lakehouse pipelines and datasets for reporting, machine learning, and analytics. Support teams across finance, sales, supply chain, and marketing.
Descriere
- Create and maintain data pipelines and datasets that enable reporting, visualization, machine learning, and informed decisions across business functions.
- Develop scalable pipelines and reusable datasets in a Databricks lakehouse.
- Ingest, validate, clean, and transform structured and unstructured data with Python, PySpark, and SQL.
- Create data models and reporting datasets for Tableau and tools such as Spotfire.
- Connect existing data warehouses and reporting systems with modern cloud analytics platforms.
- Strengthen pipeline reliability, data quality, and processing speed.
- Establish automated testing, monitoring, documentation, and CI/CD practices.
- Work with analysts, architects, developers, and business stakeholders to deliver useful data solutions.
- Guide technical work, review code, and mentor fellow data engineers.
Cerințe
- At least seven years of data engineering experience, including building and supporting production data pipelines.
- Strong SQL skills and a sound grasp of data modeling, database design, and data warehousing.
- Practical experience with Databricks, Apache Spark, and cloud data platforms.
- Strong command of Python and PySpark.
- Experience building ETL/ELT pipelines and connecting data from multiple source systems.
- Experience preparing dependable datasets for Tableau or similar business intelligence tools.
- Familiarity with version control, automated testing, and CI/CD.
- Ability to diagnose complex data issues and improve pipeline performance.
- Clear communication and experience working with technical teams and business stakeholders.
- Experience with Spotfire, Oracle, Informatica, R, or data virtualization is preferred.
- Databricks certification is preferred.