Nod CareersAuto-apply free

Data Platform Engineer

impact · Cape Town · Cape Town, Western Cape, South Africa
Auto-apply to this job with Nod →
<h2>About impact.com</h2> <p><a href="http://impact.com/">impact.com</a> is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer journey. From affiliates and influencers to content publishers, brand ambassadors, and customer advocates, <a href="http://impact.com/">impact.com</a> empowers brands to drive trusted, performance-based growth through authentic relationships. Its award-winning products—<strong>Performance</strong> (affiliate), <strong>Creator</strong> (influencer), and <strong>Advocate</strong> (customer referral)—unify every type of partner into one integrated platform. As consumers increasingly rely on recommendations from people and communities they trust, <a href="http://impact.com/">impact.com</a> helps brands show up where it matters most. Today, over 5,000 global brands, including Walmart, Uber, Shopify, Lenovo, L’Oréal, and Fanatics, rely on <a href="http://impact.com/">impact.com</a> to power more than 225,000 partnerships that deliver measurable business results.</p> <h2><strong>Your Role at Impact:</strong></h2> <p>Impact's Data Platform Engineering team is looking for a Data Platform Engineer ready to independently own production pipelines and platform components at TB-scale, delivering data reliably, securely, and cost-effectively as the business grows.</p> <p>You'll design and build scalable batch and streaming pipelines, own the reliability, performance, and SLOs of your domain, and participate fully in on-call as a Tier 2 responder. You'll work within the Data Analytics Group (DAG), partnering closely with Analytics Engineers, Data Analysts, Data Scientists, and Data Product Managers, though you won't own dbt models, metric definitions, or reporting. We operate with a platform-as-a-product mindset: the platform is an internal product with clear interfaces, paved roads, and strong developer experience, and success is measured by the productivity of the teams who depend on it. Our ideal candidate combines solid distributed systems engineering with operational maturity, clear communication, and a habit of mentoring those earlier in their careers. The role reports to the Team Lead, Data Platform Engineering, and is based in Cape Town, hybrid, with two days per week in office.</p> <h2><strong>The platform:</strong></h2> <p>The platform has strong foundations: Scala and Spark pipelines processing TB-scale data, dozens of managed data connectors, Airflow on Astronomer for orchestration, a mature dbt transformation layer, and BigQuery as the core analytical warehouse. You'll also have room to shape the platform's next chapter: modernising parts of the compute stack, and building out governance frameworks, data contracts, SLOs, observability, cost management, and data quality monitoring within your domain.</p> <h2><strong>What You'll Do:</strong></h2> <ul> <li><strong>End-to-end domain ownership:</strong> Own platform components and a pipeline domain end-to-end, including design, implementation, reliability, performance, and cost. Design and build scalable ETL/ELT and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub. Integrate diverse sources into BigQuery and other stores. Build modular, fault-tolerant components with graceful schema evolution.</li> <li><strong>Infrastructure & performance tuning:</strong> Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage. Tune performance and cost through query optimisation, partitioning, and resource configuration. Tune streaming configurations for throughput and reliability.</li> <li><strong>Reliability & incident response:</strong> Own and track SLOs for freshness, success, and latency. Implement monitoring, alerting, and data quality checks. Participate in on-call as a Tier 2 responder, troubleshooting and resolving incidents independently.</li> <li><strong>Security, governance & self-service:</strong> Implement security and governance by design, including access control, secrets, encryption, audit logging, lineage, and retention. Build self-service capabilities and paved roads for analytics engineers, analysts, and data scientists.</li> <li><strong>Engineering craft & documentation:</strong> Write clean, well-tested code with CI/CD and current runbooks and architecture docs. Use AI coding assistants while holding the same quality and review standards.</li> <li><strong>Mentorship & communication:</strong> Mentor Associate Data Platform Engineers through pairing and code review. Communicate platform trade-offs clearly and contribute to platform standards and data contracts.</li> </ul> <h2><strong>What You Have:</strong></h2> <div> <p><strong>Preferred Requirements:</strong></p> <ul> <li>3 to 5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale, or systems carrying stringent SLAs, multiple downstream consumers, or compliance requirements</li> <li>Strong Python, plus production experience in a JVM language, with the ability to write production-quality code with proper error handling, logging, and testing. Scala is our primary pipeline language: if you don't have it yet, you'll need a real appetite to become strong in it</li> <li>Hands-on depth in either distributed batch processing (Spark: DataFrames, Spark SQL, partitioning, shu

Let Nod apply for you →

More jobs at impact

Channel Partnership Manager - Agency - ANZ — impactSenior Fraud Prevention Analyst — impactSr. Data Scientist, Programmatic Algorithms — impactTechnical Project Manager — impactAssociate Solutions Architect — impactAssociate Data Platform Engineer — impact