Varsity Tutors, a Nerdy Company
Senior Data Engineer
Publicada há 1 mês
Candidatar no LinkedInSobre a vaga
<span><strong>Description<br><br></strong><strong>Overview<br><br></strong>As the Senior Data Engineer, you will own the pipelines and platform that move Nerdy’s data from source systems into a governed lakehouse. You’ll build streaming and batch ingestion, run the Iceberg lakehouse on Starburst Galaxy, and ship reliable, well-tested dbt layers that analytics engineers and analysts build on—leveraging AI to accelerate development, QA, and operations.<br><br><strong>Qualifications<br><br></strong><ul><li>Bachelor’s degree in Computer Science, Engineering, Math/Stats, or equivalent experience.</li><li>3+ years as a Data Engineer (or similar) in high-growth environments.</li><li>Expert SQL and strong Python; experience building production pipelines that run unattended and recover on their own.</li><li>Hands-on with open table formats and lakehouse engines: Iceberg on Trino/Starburst Galaxy, or similar (Delta Lake, Hudi, Spark, Databricks, Presto/Athena).</li><li>Streaming experience with Kafka/Confluent or similar (Kinesis, Redpanda), including schema registry, CDC (e.g., Debezium), and idempotent loading into lakehouse tables.</li><li>Proficiency with dbt and dbt Cloud (incremental models, macros, tests, docs) and orchestration tools such as Airflow or Dagster.</li><li>Solid AWS experience (S3, IAM, Glue/REST catalogs) and infrastructure as code (Terraform or similar).</li><li>Solid grasp of data modeling, partitioning, incremental processing, and backfill strategy on large datasets.</li><li>Git-based development and CI/CD familiarity; disciplined approach to reviews, releases, and on-call.</li><li>Experienced with AI-native tools that enhance productivity and speed (e.g., Cursor, Make, Supabase, Netlify, Claude Code, n8n, Firecrawl, ChatGPT, Grok, Bolt, Vercel, etc).</li><li>Alignment with Nerdy’s apolitical, mission-focused culture.<br><br></li></ul><strong>Responsibilities<br><br></strong><ul><li>Ingestion & streaming: Build and run streaming and batch ingestion from Kafka and third-party APIs into Iceberg tables; own CDC, schema evolution, and late-arriving data.</li><li>Lakehouse platform: Operate the Iceberg lakehouse on Starburst Galaxy (Trino)—table layout, partitioning, compaction, retention, and cluster sizing.</li><li>Layered modeling with dbt: Build and maintain the bronze, silver, and gold layers with incremental models, idempotent merges, and safe backfills; push shared logic upstream so downstream consumers stay simple.</li><li>Orchestration & reliability: Design dbt Cloud job schedules, dependencies, retries, and alerting; keep production jobs within their freshness SLAs and drive incidents to root cause.</li><li>Data quality & governance: Implement tests, contracts, freshness and volume monitoring, lineage, and access controls; handle PII within privacy and security guardrails.</li><li>Performance & cost: Tune queries, file layout, and cluster usage to improve speed and manage compute and storage spend.</li><li>Infrastructure as code: Manage clusters, storage, and access through Terraform and CI, with changes that are reviewed, reversible, and documented.</li><li>Collaboration: Partner with Analytics Engineering, Product Engineering, and business teams to turn source changes and new requirements into dependable data products.</li><li>Documentation & change control: Maintain versioned code (Git), review PRs, run CI/CD for pipelines and dbt, and document sources, models, and runbooks.</li><li>AI-enabled workflows: Use AI for code generation/review, test scaffolding, pipeline debugging, data profiling, and anomaly detection—operating within privacy and security guardrails.<br><br></li></ul><strong>Unleash Your Potential At Nerdy<br><br></strong>At Nerdy, you'll earn your success through meritocracy and exceptional outcomes. Our benefits reward performance and initiative:<br><br><ul><li>Competitive USD-Benchmarked Compensation: Earn a market-leading rate set in U.S. dollars, paid to you in local currency.</li><li>100% Remote (Home Country Only): Work from anywhere in your home country—no relocation required, no borders crossed.</li><li>Flexible Time Off: Our flexible PTO lets you recharge on your own terms and when you need it the most.</li><li>Local Holiday Pay: We honor your nation’s official holidays with paid time off—celebrate what matters to you.</li><li>Continuous Learning: Get a free, all-inclusive learning membership for you and your household—including 1-on-1 tutoring hours, unlimited on-demand classes, and access to our full suite of learning products and services.</li><li>Supercharge with AI: Gain exclusive access to cutting-edge AI tools that boost your productivity, making you feel almost super-human (cape not included).</li><li>Feedback-Rich, Collaborative Culture: Tap into regular training, peer reviews, and a team that treats every team member as a vital collaborator and owner in our success.</li><li>Make a Global Impact: Your expertise fuels an innovative platform used by learners around the world—be part of something transformative.<br><br></li></ul><strong>The Bottom Line<br><br></strong>If you're driven by impact, energized by ownership, and excited to help shape what’s next, you’ll thrive here. We move fast, think big, and reward those who deliver. This isn’t a traditional corporate environment - it’s a place to do the most meaningful work of your career.<button><span><span><span>…</span><span> mais</span></span></span></button></span>