Reality Defender (YC W22)
Reality Defender (YC W22)
Reality Defender builds AI-powered tools to help enterprises, governments, and digital platforms identify synthetic media. Its detection platform analyzes audio, video, images, and text for signs of AI generation, supporting teams in media, finance, and government as they address risks such as fraud and disinformation. The company’s multi-model approach evaluates content probabilistically, without depending on watermarks or prior authentication.

Staff Data Platform Engineer

Lead the Databricks-based data platform behind Reality Defender’s deepfake detection research. Build reproducible multimodal datasets and scalable synthetic data generation pipelines.

विवरण

  • Lead the complete data platform for AI research, from continuous ingestion and preprocessing to governance and export of high-volume image, video, audio, and text data.
  • Expand and scale the Databricks lakehouse and distributed processing stack.
  • Guide architecture and build-versus-buy decisions as data volumes increase.
  • Develop reusable infrastructure for generating synthetic data in-house across multiple modalities.
  • Establish dataset versioning, lineage, metadata, quality checks, and consistent training and evaluation splits.
  • Take responsibility for pipeline reliability, observability, and per-dataset processing costs.
  • Work with ML researchers to build self-service tools that accelerate model development.
  • Mentor engineers and strengthen code reviews, testing, documentation, and operational runbooks.
  • Coordinate with Security and compliance teams on data handling, licensing, and access controls.
  • Set the long-term data platform roadmap with engineering and research leaders.
  • Report to the Director of Data.
  • Within the first 12 months, lead a mature self-service platform, expand synthetic data generation, deliver reproducible evaluation datasets, and drive high-impact roadmap initiatives.

आवश्यकताएँ

  • At least 8 years of experience building data platforms or infrastructure, including staff- or lead-level responsibility for production pipelines that generate, ingest, or deliver high volumes of data.
  • Extensive hands-on experience with distributed processing tools such as Spark or Ray and lakehouse platforms, ideally Databricks, using cloud object storage such as S3, GCS, or Azure Blob.
  • Production experience with Databricks, Unity Catalog, Delta Lake, and Spark on AWS, including performance tuning, access controls, and operational troubleshooting.
  • Experience handling large unstructured media, such as video, audio, or images, including large files, decoding, transcoding, and metadata at scale.
  • A track record of producing reproducible ML datasets through versioning, lineage, data quality validation, and orchestration with tools such as Airflow, Dagster, or Databricks Workflows.
  • Strong Python and SQL skills.
  • Sound judgment and the ability to take ownership of ambiguous platform challenges from start to finish on a lean team.
  • Experience automating infrastructure and deployments with Terraform and CI/CD, including AWS storage, IAM, compute, Databricks resources, and distributed processing environments.
  • Synthetic data generation pipeline development or experience running generative models at scale is a plus.
  • Experience supporting ML research teams with training and evaluation data, particularly for multimodal models, is a plus.
  • Experience in security, fraud, trust and safety, another adversarial field, or at a Series A or B startup is a plus.
  • The application requests authorization to work in the United States.
  • Willingness to relocate if not currently based in or near New York City, depending on the work arrangement.

लाभ

  • Employee healthcare premiums are fully covered, with partial coverage available for dependents.
  • Employee and dependent dental and vision premiums are fully covered.
  • Employee short- and long-term disability and life insurance premiums are fully covered.
  • Flexible spending and health savings accounts, plus a 401(k) program.
  • Equity compensation.
  • 20 days of paid time off each year.
  • 12 weeks of parental leave.
  • Learning and development budget.
  • Monthly wellness benefits.
  • Annual company-sponsored offsite.
  • Daily in-office lunch via Uber Eats for employees at the New York City headquarters.
  • Commuter benefits for employees at the New York City headquarters.
  • Remote Fridays for employees at the New York City headquarters.
  • Happy hours and other local events for employees at the New York City headquarters.
  • Eligibility for an annual performance bonus.

संबंधित नौकरियाँ

Public Partnerships | PPL

Principal Data Architect, Databricks and Azure

Public Partnerships | PPL

Lead the design of governed Databricks and Azure analytics platforms supporting Medicaid financial management services. Build master data capabilities, resolve participant and provider identities, and deliver compliant data products at nationwide scale.

खोलें
L3Harris Technologies

Chief Data Architect, Palantir

L3Harris Technologies

Lead ontology, integration, and governance for L3Harris Technologies’ enterprise Palantir data and AI program. Shape a unified data architecture spanning approximately 100 legacy systems.

खोलें
Sony Interactive Entertainment

Staff Data Software Engineer, Sony Interactive Entertainment (Remote, US)

Sony Interactive Entertainment

Build the real-time analytics platforms behind PlayStation. Lead distributed data architecture, streaming infrastructure, and AI tools that improve engineering productivity.

खोलें
GameChanger

Staff Data Engineer

GameChanger
51 – 200 कर्मचारी
SaaSखेलमीडिया

Set technical direction and build AI-enabled data platforms that power analytics and product capabilities for GameChanger’s youth sports technology business.

खोलें
Robots & Pencils

Principal Data Architect (Canada Remote)

Robots & Pencils

Set data architecture direction for enterprise AI systems at Robots & Pencils, building scalable, governed platforms. Advise clients and mentor senior technical teams.

खोलें