Guide customers in building big data solutions on Databricks in a senior technical role focused on data engineering.
Posted by employer 1 month ago
First seen on Joblaze 1 month ago
Last verified on the company career page 4 hours ago
Not disclosed in this posting: work arrangement, visa sponsorship.
Joblaze summary
In the role of Specialist Solutions Architect for Data Engineering, the individual will focus on guiding clients in the development of big data solutions using Databricks, ensuring successful implementation and optimization of data pipelines. Key skills include hands-on experience with Apache Spark and familiarity with data ingestion and streaming technologies. This position is ideal for someone with over five years of technical experience, particularly in customer-facing roles, who can navigate complex data challenges. The role also emphasizes continuous learning and specialization in areas like data lake technology or performance tuning.
Quick facts
- What's the salary range?
- Databricks lists $264,000–$363,000 for this role.
- How much experience is required?
- At least 5 years of relevant experience for this Specialist Solutions Architect - AI/ML (Healthcare & Life Sciences) role.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AWS, Apache Spark, Azure, GCP, Java, Kafka.
- What seniority level is this role?
- Databricks targets senior candidates for this position.
- Is this full-time or contract?
- Full-time for this Specialist Solutions Architect - AI/ML (Healthcare & Life Sciences) role at Databricks.
From the original posting
FEQ427R390
As a Specialist Solutions Architect (SSA) on the Healthcare & Life Sciences team, you will help Payers and Providers put generative AI to work at the center of their business. For Payers, that means prior authorization, claims, payment integrity, risk adjustment and the member experience. For Providers, it means clinical documentation, care management, the revenue cycle and the patient experience. Both run on complex, highly regulated data such as EHR records, claims and clinical notes. You will help them turn that data into AI on Databricks that is accurate, governed and ready for production.
In this customer-facing role, you will work with and support Solution Architects, helping customers design and implement essential workloads and shape their roadmap for expanding use of the Databricks Data Intelligence Platform. As a go-to expert reporting to the Specialist Field Engineering Manager, you will keep building your skills through mentorship, learning and internal training. You will also deepen a specialty in generative AI, AI agents, Healthcare or another area.
The impact you will have
- Guide strategic Payer and Provider customers from AI prototype to production, architecting generative AI applications and agents with retrieval-augmented generation (RAG), fine-tuned or open foundation models, and the data platforms behind them
- Build agents for Payer and Provider workflows such as medical coding, utilization review and member and patient service, including multi-agent systems, tool calling and Model Context Protocol (MCP) integrations
- Apply generative AI to clinical notes, charts, call transcripts and documents for summarization, extraction and chart review
- Ground AI in governed data through context engineering, semantic layers and natural-language analytics with Genie, so agents answer from trusted business definitions
- Set up evaluation, tracing and monitoring for AI quality, cost and latency, including LLM judges, human feedback and guardrails, using MLflow
- Build the data foundations behind AI, including batch and streaming pipelines, data warehouses and migrations from legacy platforms such as Teradata, Oracle, SQL Server, Informatica and SAS
- Bring machine learning in where it fits, such as risk, fraud and forecasting models that work alongside generative AI and agents
- Help customers work with healthcare data such as EHR, FHIR, HL7 and claims, and meet HIPAA and PHI requirements through governance with Unity Catalog
- Use AI tools, including coding assistants and agents, to move quickly from a customer problem to a working prototype and reusable solution accelerators
- Support Solution Architects on the advanced parts of the technical sale, including custom proof-of-concept content, workload sizing estimates and custom architectures
- Grow adoption of Databricks with customers and the broader community through tutorials, training, hackathons, blogs and Healthcare conference presentations
What we look for
- 5+ years of hands-on experience in a technical role, with recent hands-on work building generative AI applications or agents
- Expertise in generative AI and agents, including LLMs, RAG, agent frameworks, tool calling and MCP, prompt and context engineering, fine-tuning, evaluation and guardrails
- Experience taking AI applications or agents to production to solve business problems, including tracing, evaluation, monitoring, serving and cost control, with tools like MLflow
- A strong foundation in data engineering, data warehousing or machine learning, such as pipelines and streaming, data modeling and SQL performance, warehouse migrations, model development and MLOps
- Experience maintaining and extending production data systems as needs grow more complex
- Comfort using AI coding assistants and agents in day-to-day development and prototyping
- Production programming experience in SQL and Python, Scala or Java
- 2 years of hands-on professional experience with big data technologies (such as Spark, Hadoop and Kafka) and architectures
- 2 years of customer-facing experience in a pre-sales or post-sales role
- Bachelor’s degree in Computer Science, Information Systems or Engineering, or equivalent work experience
- Ability to meet technical training and role-specific expectations within 6 months of hire
- Ability to travel up to 30% when needed
Preferred qualifications:
- Education in a healthcare-related field (for example health informatics, biostatistics, epidemiology, public health or health economics), or equivalent experience
- Experience with Payers or Providers, such as claims, care management, risk adjustment, quality measures, clinical operations, EHR data or revenue cycle management
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected base salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipated utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Zone 1 Pay Range
$180,000—$247,500 USD
Zone 2 Pay Range
$180,000—$247,500 USD
Zone 3 Pay Range
$180,000—$247,500 USD
Zone 4 Pay Range
$180,000—$247,500 USD
Standard company text repeated across Databricks's postings is omitted here.