Join Databricks as a Senior Software Engineer to build distributed systems for seamless data ingestion at scale.
Posted by employer 2 days ago
First seen on Joblaze 1 day ago
Last verified on the company career page 14 minutes ago
What you'll build
Must have
Nice to have
AI in the day-to-day
Comfortable using AI tools and defining effective evals to shorten the development loop.
Requirements
Not disclosed in this posting: work arrangement, visa sponsorship.
Joblaze summary
The Sr. Software Engineer on the Ingestion Core team at Databricks focuses on developing distributed systems to streamline the ingestion of high-volume data from various sources into Delta Lake. Key skills include proficiency in languages like Java, Scala, or Python, along with experience in building large-scale distributed systems and optimizing for performance and cost. This role is suited for engineers with over five years of experience who are comfortable with complex data processing challenges. The team is integral to enhancing the company's data and AI capabilities.
Joblaze insights
Quick facts
From the original posting
Deeply understanding what’s in the enterprise data has been a challenge that Databricks has been addressing by providing analytics and machine learning tools. From data warehousing with Databricks SQL to large-scale distributed processing with Spark and advanced ML tools for experimentation and model serving, we empower our customers to gain insights and drive innovation.
To enable all of this on Databricks, making data ingestion seamless is crucial. That’s the mission of the Ingestion Core Team: to make the ingestion of all data—structured and unstructured—simple, reliable, and efficient. Simplifying the complex is hard, and that’s where you come in. This role requires building distributed platform systems to incrementally ingest high-volume, petabyte-scale data from diverse sources—including cloud storage (SQS, ADLS, GCS), databases (Oracle, SQL Server, MySQL, Postgres), and file sources (Google Drive, SharePoint)—at high throughput and low cost. The data includes structured formats (JSON, Parquet, CSV) as well as unstructured data (text, images, docs, PPTs, and blobs), all of which land in Delta Lake with schema evolution and change data capture (CDC) capabilities.
Join us in making data ingestion effortless and be part of the team that powers the future of AI + data at Databricks!
As an engineer on the team, you will work on projects that:
Ideal Engineer should have:
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
About Databricks
BenefitsStandard company text repeated across Databricks's postings is omitted here.