SunnyData este o firmă de consultanță în ingineria datelor și inteligență artificială, axată pe Databricks. Inginerii săi certificați Databricks ajută organizațiile să își modernizeze platformele de date, să migreze depozitele de date corporative și lacurile de date tradiționale și să transforme inițiativele de inteligență artificială, învățare automată și inteligență artificială generativă în sisteme operaționale. Compania oferă, de asemenea, suport pentru guvernanța datelor și MLOps, având expertiză în domeniile sănătății, serviciilor financiare și logisticii.
Design and deliver Databricks data, engineering, and AI solutions for SunnyData customers. Balance client delivery with pre-sales, leading architecture, implementation, and customer engagement.
Design data architectures that follow sound practices for governance, security, and quality.
Assess data sources and recommend which data to include.
Guide internal teams and mentor project contributors.
Help end users understand data products and analytics environments.
Investigate system issues, fix data and system defects, and apply corrective changes.
Validate data movement, transformation code, and data components for accuracy and reliability.
Cerințe
Bring at least seven years of hands-on experience as a Solutions Architect and/or Senior Data Engineer.
Have recent experience implementing data solutions, particularly with Databricks.
Bring expert-level knowledge of data engineering technologies such as Spark, Hadoop, and Kafka.
Have expert knowledge of the Databricks platform.
Know data science and machine learning tools such as pandas and scikit-learn.
Understand end-to-end analytics workflows, including data modeling, ETL, and data integration.
Be able to lead complex architecture discovery and solution design sessions.
Be able to produce architecture blueprints for implementation.
Be proficient in Java, Python, and/or Scala.
Have experience with AWS, Azure, and/or Google Cloud Platform.
Be able to write, debug, and optimize SQL queries.
Communicate effectively in writing and conversation, with experience working directly with clients.
Be able to prepare and deliver detailed presentations.
Have created solution documentation such as proofs of concept, roadmaps, sequence diagrams, class hierarchies, and logical system views.
Have experience leading teams and mentoring engineers.
Be able to take end-to-end technical solutions into production with attention to performance, security, scalability, and reliable data integration.
Hold a bachelor’s degree in Computer Science or a related engineering discipline.
Select an English proficiency level of Basic, Intermediate, or Advanced.
At least two of these Databricks certifications are preferred: Associate Developer for Apache Spark, Data Engineer Associate, Professional Data Engineer, Machine Learning Associate, or Professional ML Engineer.
Familiarity with distributed storage systems is preferred, including S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL systems.
Experience with data integration tools is preferred, such as Spark, Kafka, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, and IICS.
Broad software development lifecycle experience is preferred.
Expertise in automated data transformation and curation is preferred, using tools such as dbt, Spark, Spark Streaming, and automated pipelines.
Experience with workflow management and orchestration tools is preferred, including Airflow, AWS Managed Airflow, Luigi, and NiFi.
Beneficii
Opportunities to develop professionally and advance your career.
Work with modern technologies and leaders in data engineering and AI.
Join a collaborative, supportive culture that encourages sharing knowledge.
Shape SaaS solutions for Toolbox, a provider of technology for online TV services. Connect Sales and Engineering through customer presentations, project scoping, and responses to RFIs and RFPs.