Circana
Circana
5 001 – 10 000 Қызметкерлер
B2BКонсалтинг
Circana — брендтер мен бөлшек сауда компанияларына сұранысты түсінуге және тиімдірек шешімдер қабылдауға көмектесетін нарықты зерттеу және консалтинг компаниясы. Компанияның жұмысы интернеттегі және физикалық дүкендердегі тұтынушылардың мінез-құлқын талдау үшін ауқымды сатып алу деректерін жасанды интеллект негізіндегі визуализациямен ұштастырып, инновация, өсу және өзгеріп жатқан нарық қажеттіліктерін қанағаттандыру сияқты міндеттерді шешуге қолдау көрсетеді. IRI және NPD ұйымдарының мұрасы негізінде құрылған Circana әлем бойынша 7 000-нан астам бренд пен бөлшек сауда компаниясына мол салалық тәжірибесін ұсынады. Компанияның зерттеулері мен талдаулары Bloomberg, CNBC және The New York Times сияқты басылымдарда жарияланған.

Senior Director of Software Engineering, Data Engineering

Lead Azure data engineering teams at Circana, a global market intelligence company. Build scalable Spark pipelines and guide AI-assisted engineering practices.

Сипаттама

  • Create and refine scalable data workflows with Python, PySpark, and Airflow
  • Process data in real time and in batches with Spark
  • Apply data quality, governance, and security practices across the data lifecycle
  • Maintain data availability, reliability, and performance through monitoring and automation
  • Manage cloud infrastructure and control costs for data processing workloads
  • Build CI/CD pipelines for data workflows
  • Develop and improve large-scale processing pipelines with Apache Spark and PySpark
  • Tune Spark workloads through partitioning, caching, and performance optimization
  • Use structured and unstructured data for analytics and machine learning initiatives
  • Create and maintain Airflow DAGs to automate complex workflows
  • Monitor, troubleshoot, and improve job execution and dependencies
  • Lead and mentor data engineers, providing technical direction
  • Promote coding standards, version control, and sound documentation practices
  • Work directly with clients to understand business needs and explain technical concepts
  • Partner with engineering, product, and architecture teams to build scalable, maintainable products
  • Coordinate with Program Management on delivery timelines and risk mitigation

Талаптар

  • At least 8 years of data engineering experience
  • Expert knowledge of Python, PySpark, Apache Spark, and Apache Airflow
  • Strong Python and SQL programming skills
  • Ability to write efficient, maintainable code
  • In-depth knowledge of Spark internals, including RDDs, DataFrames, DAG execution, and partitioning
  • Experience creating Airflow DAGs and managing scheduling and dependencies
  • Knowledge of Git, Docker, Kubernetes, Terraform, and DevOps practices for CI/CD workflows
  • Experience optimizing large-scale data processing
  • Experience leading teams and working in Agile or Scrum environments
  • Experience with common data warehouse or data lake platforms
  • Knowledge of cloud technologies such as Azure, AWS, or Google Cloud
  • Demonstrated use of generative AI tools for software development, data engineering, system design, testing, and troubleshooting
  • Strong grasp of AI-assisted engineering, including prompt engineering, code generation, automated testing, and AI-driven productivity workflows
  • Ability to identify ways AI can improve team productivity, code quality, and operational efficiency
  • Machine learning engineering experience is a plus
  • Strong communication and collaboration skills
  • Ability to work effectively with remote teams
  • Candidates may be asked to consent to background checks

Артықшылықтар

  • Flexible and accommodating work environment
  • Paid time off
  • Medical, dental, and vision insurance
  • 401(k) plan
  • Eligibility for bonus pay
  • Commitment to diversity, equity, and inclusion
  • Accessibility accommodations for applicants with disabilities
  • Background checks conducted in accordance with local law
  • Current employer will not be contacted without permission

Ұқсас жұмыс орындары

RSM US LLP
U.S. Bank
Honeywell Aerospace Technologies

Software Engineer II, Aerospace Software

Honeywell Aerospace Technologies

Develop and test embedded software for aerospace systems at Honeywell Aerospace Technologies. Work with engineering teams on hardware integration, debugging, and reliable flight-system solutions.

Ашу
Zendesk
PwC
PwC