Senior Data Engineer
Company : Adoration Home Health & Hospice
Location : Louisville, KY, 40222
Job Type : Full Time
Date Posted : 28 December 2025
Our Company
BrightSpring Health Services
Overview
We are seeking an experienced Senior Data Engineer to join our team in building a next generation AI-enabled Health Cloud Platform. This platform powers intelligent clinical and pharmacy solutions using Generative AI, Agentic AI, Robotic Process Automation (RPA), and Retrieval-Augmented Generation (RAG) with domain-specific vector databases.
As a Senior Data Engineer, you will design and optimize data pipelines, data lakes, and analytics frameworks that enable scalable AI/ML workflows. You will work closely with AI architects, data scientists, and product teams to ensure high-quality, secure, and compliant data infrastructure for healthcare applications.
Responsibilities
- Design, build, and maintain data pipelines for ingesting, transforming, and storing large-scale healthcare datasets.
- Implement ETL/ELT workflows using Databricks, Spark, and Delta Lake for high performance data processing.
- Optimize data architecture for AI/ML workloads, including support for vector databases and RAG pipelines.
- Collaborate with AI teams to integrate structured and unstructured data into predictive and generative AI models.
- Ensure compliance with healthcare data standards (FHIR, HL7, RxNorm) and regulatory requirements (HIPAA).
- Develop and enforce data governance, security, and quality frameworks.
- Monitor and improve data pipeline performance, scalability, and reliability.
- Mentor junior engineers and contribute to best practices in data engineering and MLOps.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- 10+ years of experience in data engineering with strong expertise in Databricks, Spark, and distributed data systems.
- Proficiency in Python, SQL, and experience with data modeling and data lakehouse architectures.
- Hands-on experience with cloud platforms (Azure preferred; AWS/GCP acceptable).
- Experience with vector databases (FAISS, Weaviate, Pinecone) and RAG pipelines.
- Familiarity with MLOps tools (MLflow, Airflow, or similar) and data versioning.
- Strong understanding of healthcare data standards and compliance frameworks.
- Excellent problem-solving skills and ability to work in a fast-paced, mission-driven environment.
- Knowledge of Generative AI and Agentic AI frameworks (LangChain, AutoGen).
- Familiarity with data security, privacy, and regulatory compliance in healthcare.
- Contributions to open-source projects or experience in large-scale data environments.
- Travel up to 25%
About our Line of Business
BrightSpring Health Services provides complementary home- and community-based pharmacy and provider health solutions for complex populations in need of specialized and/or chronic care. Through the Company’s service lines, including pharmacy, home health care and primary care, and rehabilitation and behavioral health, we provide comprehensive and more integrated care and clinical solutions in all 50 states to over 450,000 customers, clients and patients daily. BrightSpring has consistently demonstrated strong and often industry-leading quality metrics across its services lines while improving the quality of life and health for high-need individuals and reducing overall costs to the healthcare system. For more information, please visit www.brightspringhealth.com. Follow us on Facebook, LinkedIn, and X.Related Jobs
Top trending job titles hiring now
Popular Searches for Senior Data Engineer
Frequently asked questions
Louisville's healthcare sector is expanding its AI capabilities, creating a rising demand for senior data engineers skilled in generative AI and RPA. This makes competition moderate, with employers seeking candidates who have deep expertise in healthcare data standards and scalable AI data pipelines.
Certifications like Microsoft Azure Data Engineer Associate and specialized training in healthcare data compliance (HIPAA, FHIR) significantly boost hiring chances in Louisville. Familiarity with Spark, Databricks, and cloud AI frameworks is highly valued in this regional health technology market.
Senior data engineers must master complex data orchestration with databricks and spark, coupled with expertise in AI/ML workflow optimization and healthcare compliance. Leadership in mentoring and implementing vector databases for AI use cases distinguishes this senior-level role.
Senior data engineers focus on architecting scalable data pipelines and ensuring security and compliance for sensitive healthcare data, while mentoring teams and driving innovation with AI-enabled platforms. Mid or junior engineers handle more routine data processing and support tasks.
Salaries at Adoration Home Health & Hospice align with Louisville’s market average for senior data engineers, typically ranging from $120,000 to $140,000 annually, reflecting the specialized healthcare AI skills and compliance knowledge required in this role.
At Adoration, senior data engineers engage with cutting-edge AI technologies like agentic AI and retrieval-augmented generation, contributing to innovations that enhance patient care through intelligent clinical solutions—an exceptional chance to impact healthcare at scale.
In healthcare, Adoration enforces stringent data governance and HIPAA compliance, requiring senior data engineers to implement robust security and quality controls that exceed typical industry standards, ensuring sensitive patient data is handled with utmost care.
Vector databases like FAISS or Pinecone enable efficient handling of unstructured healthcare data, essential for AI model accuracy. Senior data engineers architect these systems and integrate RAG pipelines, supporting predictive and generative AI critical to clinical solutions.
Candidates should anticipate up to 25% travel, typically for meetings with clinical teams or technology partners across healthcare facilities, which supports collaborative development of AI-driven health platforms tailored to diverse patient needs.