Bitful is a technology consulting firm that works with organizations across telecommunications, government, defense, logistics, and healthcare. Its services include cloud infrastructure, data analytics consulting, and custom software design and development. The company describes its approach as human-centered, with a focus on expanding access to technology and creating opportunities in underserved communities. Bitful also shares profits and contributes part of them to technology mentorship programs.
Senior Data Engineer, Databricks
Build Databricks lakehouse pipelines and datasets for reporting, machine learning, and analytics. Support teams across finance, sales, supply chain, and marketing.
Сипаттама
- Create and maintain data pipelines and datasets that enable reporting, visualization, machine learning, and informed decisions across business functions.
- Develop scalable pipelines and reusable datasets in a Databricks lakehouse.
- Ingest, validate, clean, and transform structured and unstructured data with Python, PySpark, and SQL.
- Create data models and reporting datasets for Tableau and tools such as Spotfire.
- Connect existing data warehouses and reporting systems with modern cloud analytics platforms.
- Strengthen pipeline reliability, data quality, and processing speed.
- Establish automated testing, monitoring, documentation, and CI/CD practices.
- Work with analysts, architects, developers, and business stakeholders to deliver useful data solutions.
- Guide technical work, review code, and mentor fellow data engineers.
Талаптар
- At least seven years of data engineering experience, including building and supporting production data pipelines.
- Strong SQL skills and a sound grasp of data modeling, database design, and data warehousing.
- Practical experience with Databricks, Apache Spark, and cloud data platforms.
- Strong command of Python and PySpark.
- Experience building ETL/ELT pipelines and connecting data from multiple source systems.
- Experience preparing dependable datasets for Tableau or similar business intelligence tools.
- Familiarity with version control, automated testing, and CI/CD.
- Ability to diagnose complex data issues and improve pipeline performance.
- Clear communication and experience working with technical teams and business stakeholders.
- Experience with Spotfire, Oracle, Informatica, R, or data virtualization is preferred.
- Databricks certification is preferred.