Databricks - Tech Lead II - GR - 40516-75564 - JR206256

Position Title: Databricks - Tech Lead II - GR - 40516-75564 - JR206256 Job Family: IFT > Engineering​/Dev Shift: Job Description: Job Title Tech Lead II Requirement Type Full-Time Employee Job Location Bangalore/Gurugram Job Level Lead Hiring Manager Senior Delivery Manager Primary Skill Databricks, AWS/GCP Business EDA Platform Individual Contributor / People Manager Individual Contributor ABOUT ELEVANCE HEALTH Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 112 million individuals across 14 states. A regular in Fortune 500 list, Elevance Health ranked 18 in 2026. Gail Boudreaux, President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 81st rank on this list. ABOUT CARELON GLOBAL SOLUTIONS Carelon Global Solutions (CGS) is a healthcare solutions company simplifying complex operational processes to improve the health of the healthcare system. Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health (Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers. Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient. OUR MISSION & VALUES Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More. Our Values: Leadership | Community | Integrity | Agility | Diversity JOB PURPOSE • Carelon Global Solutions India is seeking for a Tech Lead II. JOB RESPONSIBILITY Technical Leadership • Lead development and implementation of scalable data engineering solutions. • Drive end-to-end data pipeline development using Databricks and Python. • Design batch and real-time data processing frameworks. • Review code and establish engineering best practices. • Guide teams on performance optimization and reliability improvements. Data Engineering & Analytics • Build and maintain ETL/ELT pipelines using Databricks, Spark, and Python. • Develop scalable data lakehouse architectures. • Implement data quality, governance, and observability frameworks. • Optimize Snowflake workloads and data models. • Design Iceberg-based data lakes for large-scale analytics. Cloud & Platform Engineering • Work with AWS/GCP cloud services. • Develop cloud-native data solutions using managed services. • Awareness of CI/CD pipelines and Infrastructure as Code. • Support platform modernization and cloud migration initiatives. Stakeholder Management • Partner with architects, product owners, and business stakeholders. • Translate business requirements into technical solutions. • Provide effort estimation and delivery planning. QUALIFICATION • B.Tech degree/MCA with computer science background or equivalent experience. EXPERIENCE • 7 years of total and minimum 3 years of relevant experience in Databricks. • Proven hands-on experience with Databricks , including designing and implementing scalable data lakehouse solutions. • Strong expertise in Python and PySpark for developing enterprise-grade data pipelines and distributed processing frameworks. • Extensive experience with Snowflake, including data modeling, performance tuning, query optimization, and cost management. • Hands-on experience with Apache Iceberg, Delta Lake, and modern open table formats for large-scale data lake implementations. • Strong understanding of AWS/GCP cloud services, architecture design, deployment, and platform operations. • Experience in building batch and real-time data processing pipelines using Spark, Kafka, and cloud-native services. • Proven expertise in ETL/ELT design, data integration, and cloud migration initiatives. • Experience leading development teams and delivering data modernization programs. • Strong troubleshooting and analytical skills with the ability to resolve complex production issues. • Excellent stakeholder management and communication skills, working across technical and business teams. SKILLS AND COMPETENCIES • Expert knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and Performance Optimization. • Strong proficiency in Python, PySpark, Spark SQL, and distributed data processing. • Extensive hands-on experience with Snowflake, including Snowpipe, Streams, Tasks, Data Sharing, and Query Optimization. • Strong expertise in Apache Iceberg, open table formats, schema evolution, partitioning, and time-travel capabilities. • Experience designing and implementing large-scale Data Engineering and ETL/ELT Pipelines. • Hands-on experience with AWS/Azure/GCP cloud-native data services. • Strong SQL and data modeling skills across OLTP and analytical environments. • Experience with Real-Time Data Processing using Kafka, Event Hubs, Kinesis, or Pub/Sub. • Knowledge of Data Governance, Metadata Management, Data Quality, and Security frameworks. Good to Have • Experience with Terraform, CloudFormation, or Infrastructure as Code (IaC). • Knowledge of Docker, Kubernetes, and containerized data platforms. • Experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, or GitLab. • Exposure to AI/ML, MLOps, and GenAI data platform integration. • Knowledge of Data Mesh, Data Fabric, and modern enterprise data architectures. • Databricks, Snowflake, an