Software Engineer - Lakeflow PhD Candidates Mountain View, California

Company: Databricks Inc.
Location: Mountain View
Posted on: May 18, 2025

Job Description:

Databricks is radically simplifying the entire data lifecycle, from ingestion to generative AI and everything in-between. We're doing it cross-cloud with a unified platform, serving over 10k customers, processing exabytes of data/day on 15+ million VMs, and growing exponentially.The Lakeflow team is looking for recent PhD graduates. The team includes products like Apache Spark Structured Streaming, Delta Live Tables (DLT), and Materialized Views. Apache Spark Structured Streaming is one of the world's most popular streaming engines. DLT simplifies building and managing reliable batch and streaming data pipelines on the Databricks Lakehouse Platform, with features like declarative pipeline development, automatic data testing, and deep monitoring and recovery capabilities. DLT also optimizes pipeline execution through logical and physical optimization techniques, including instance type selection and autoscaling.Additionally, DLT features Eenzyme, a catalyst optimization layer designed to accelerate ETL processes and enable declarative ETL computation by incrementally computing and materializing intermediate results. Eenzyme maintains up-to-date materializations of query results stored in Delta tables using a cost model that selects among various techniques inspired by traditional materialized view maintenance, delta-to-delta streaming, and manual ETL patterns.As part of the Lakeflow DLT team, there are opportunities to innovate in areas such as:

• Query compilation and optimization
• Distributed query execution and scheduling
• Resource management
• Transaction coordination
• Automatic physical data optimizationWhat We Look For:

• PhD in databases or systems
• Knowledge of database systems, storage systems, distributed systems, and performance optimization
• Motivated by delivering customer value and influenceDatabricks is committed to fair and equitable compensation practices. The salary range for this role is $142,200 - $204,600 USD, depending on factors like skills, experience, and location. Compensation may include bonuses, equity, and benefits. For more details, visit our benefits page.About Databricks:Databricks is the data and AI company trusted by over 10,000 organizations worldwide, including Fortune 500 companies. Headquartered in San Francisco, we are the creators of Lakehouse, Apache Spark, Delta Lake, and MLflow. Follow us on Twitter, LinkedIn, and Facebook for updates.Benefits:We offer comprehensive benefits tailored to regional needs. More information can be found at https://www.mybenefitsnow.com/databricks.Our Commitment to Diversity and Inclusion:We foster a diverse and inclusive culture, considering all applicants equally regardless of age, gender, ethnicity, disability, or other protected characteristics.Compliance:If access to export-controlled technology or source code is required, the employer may need to seek a U.S. government license, and may decline to proceed with an applicant based on this requirement.
  #J-18808-Ljbffr

Keywords: Databricks Inc., Laguna , Software Engineer - Lakeflow PhD Candidates Mountain View, California, IT / Software / Systems , Mountain View, California