Nod CareersAuto-apply free

Data Engineer with DataBricks

capco · India - Pune · India - Pune
Auto-apply to this job with Nod →
<p></p> <h3></h3> <p><strong></strong></p> <p><strong>Data Engineer (AWS/Databricks)</strong></p> <p><strong>About Us</strong></p> <p><em>“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with </em><strong><em>Consultancy of the year in the British Bank Award</em></strong><em> and has been ranked </em><strong><em>Top 100 Best Companies for Women in India 2022 by <a href="https://avtarinc.com/what-we-do/enrich-diversity/best-companies-for-women/" target="_blank">Avtar & Seramount</a></em></strong><em><a href="https://avtarinc.com/what-we-do/enrich-diversity/best-companies-for-women/" target="_blank">. </a></em><strong><em>With</em></strong><em> our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.</em></p> <p><strong><em>WHY JOIN CAPCO?</em></strong></p> <p>You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.</p> <p><strong><em>MAKE AN IMPACT</em></strong></p> <p>Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.</p> <p><strong><em>BEYOURSELFATWORK</em></strong></p> <p>Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.</p> <p><strong><em>CAREER ADVANCEMENT</em></strong></p> <p><em>With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.</em></p> <p><strong><em>DIVERSITY & INCLUSION</em></strong></p> <p><em>We believe that diversity of people and perspective gives us a competitive advantage.</em></p> <p><strong>Job Title: Senior Data Engineer (AWS/Databricks)</strong><br><strong>Experience:</strong> 5+ Years<br><strong>Location:</strong> Pune<br><strong>Interview Process:</strong> One mandatory in-person interview round at the client's office in Pune</p> <h2>Job Summary</h2> <p>We are looking for a highly skilled and experienced <strong>Senior Data Engineer (AWS/Databricks)</strong> with 5+ years of hands-on experience in designing, developing, and optimizing scalable data engineering solutions.</p> <p>The ideal candidate should have strong expertise in <strong>Python, SQL, PySpark, AWS, Databricks, ETL/ELT pipelines, and cloud-based data platforms</strong>. The role requires strong technical capabilities in distributed data processing, data modeling, performance optimization, and building enterprise-grade data solutions.</p> <p>The candidate should be capable of independently delivering complex data engineering solutions, collaborating with cross-functional teams, and implementing engineering best practices.</p> <h2>Key Responsibilities</h2> <ul> <li>Design, develop, and maintain scalable, reliable, and high-performance data pipelines using Python, PySpark, SQL, and Databricks.</li> <li>Build and optimize ETL/ELT pipelines for large-scale data ingestion, transformation, and integration.</li> <li>Develop and manage cloud-based data engineering solutions leveraging AWS services and Databricks.</li> <li>Write complex SQL queries, perform data modeling, and implement query optimization and performance tuning techniques.</li> <li>Design and implement distributed data processing solutions using Apache Spark and PySpark.</li> <li>Work with data lakes, cloud-based storage solutions, and enterprise data platforms.</li> <li>Implement CI/CD pipelines, automated deployments, and DevOps best practices for data engineering workloads.</li> <li>Ensure data quality, governance, security, compliance, and reliability across data pipelines.</li> <li>Troubleshoot pipeline failures, identify performance bottlenecks, and implement optimization strategies.</li> <li>Collaborate with data architects, data scientists, business analysts, and engineering teams to deliver end-to-end data solutions.</li> <li>Participate in Agile/Scrum ceremonies, technical discussions, design reviews, and code reviews.</li> <li>Contribute to the adoption of modern cloud-native data engineering practices and emerging technologies.</li> </ul> <h2>Required Technical Skills</h2> <p><strong>1. Python</strong></p> <ul> <li>Strong hands-on programming expertise in Python.</li> <li>Experience developing production-grade data engineering applications, automation scripts, and reusable components.</li> <li>Ability to write clean, efficient, maintainable, and scalable code.</li> </ul> <p><strong>2. SQL & Data Modeling</strong></p> <ul> <li>Expert-level SQL skills, including complex joins, window functions, CTEs, and advanced data transformations.</li> <li>Strong experience in data modeling, query optimization, and performance tuning.</li> <li>Ability

Let Nod apply for you →

More jobs at capco

BA- Insurance — capcoTechnical Product Owner -NW — capcoBack-End Engineer - Java (Payments) — capcoDesenhista Projetista Pleno - Híbrido - Santos/SP — capcoConsultor Especialista em Conformidade I - Híbrido - RJ — capcoEngenheiro de Qualidade - Híbrido - Santos/SP e Rio de Janeiro/RJ — capco