Talent.com
Senior Data Platform Engineer (GCP / BigQuery, Dagster / dbt)

Senior Data Platform Engineer (GCP / BigQuery, Dagster / dbt)

IMPROVLearningPeru
Hace 4 días
Descripción del trabajo

3 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from IMPROVLearning

Our Mission : To Save Lives

Our Vision : Rethink the Ordinary

IMPROV Learning is a leader in innovative and engaging educational solutions. We combine entertainment and education to create programs that make complex topics more accessible, engaging, and impactful.

About the Role

We are seeking a Senior Data Engineer to stabilize and modernize our reporting / data platform for an online driver-safety education business. You will design, build, and operate reliable data pipelines and models on BigQuery that power >

200 compliance reports to DMVs, insurers, and partners, replacing brittle scripts with tested, observable workflows and enabling a lightweight self-service layer for operations and compliance.

Key Responsibilities

  • Own the end-to-end design, build, and operation of data pipelines ingesting from LMS, e-commerce, and marketing systems into BigQuery
  • Refactor legacy jobs into versioned dbt models with robust testing and documentation
  • Implement orchestration with Dagster (or similar) including scheduling, dependencies, retries, and backfills
  • Establish monitoring, alerting, and runbooks to ensure SLA compliance and rapid incident response
  • Build parameterized report templates that render CSV / XLSX / XML with SFTP / API / email delivery and auditable logs
  • Define and enforce data contracts and schema evolution practices with source systems
  • Optimize BigQuery performance and cost via partitioning, clustering, and query / job best practices
  • Implement security, IAM, secrets management, and PII safeguards in GCP
  • Partner with operations / compliance to expose curated datasets and safe self-service entry points
  • Produce clear ERDs, data dictionaries, pipeline diagrams, and knowledge-transfer materials

Technical Requirements

  • Python for ingestion, transformation, templated exports, and automation
  • SQL (BigQuery) with strong optimization strategies (partitioning, clustering, materialized views)
  • Orchestration with Dagster preferred (Airflow / Prefect acceptable) for production scheduling and reliability
  • dbt for modeling, testing, documentation, and lineage
  • GCP services including BigQuery, Cloud Storage; comfort with Cloud Run / Functions a plus
  • File and transport protocols (SFTP / FTPS, REST APIs, webhooks) and formats (CSV / XLSX / XML) including PGP / GPG encryption
  • Observability and alerting using Dagster and / or GCP Logging / Monitoring; Git-based CI / CD workflows
  • Nice To Have

  • Connector tooling (Airbyte, Fivetran, Google Apps Script or similar)
  • BI enablement experience (Looker, Power BI) for internal analytics
  • Familiarity with LMS / e-commerce data and compliance reporting specifications
  • Qualifications

  • 5–8+ years of data engineering experience delivering production-grade pipelines on a cloud data warehouse (BigQuery strongly preferred)
  • Demonstrated ability to convert under-documented, script-heavy workflows into tested, observable, maintainable platforms
  • Proven success operating pipelines with SLAs, including monitoring, incident response, and postmortems
  • Strong communication skills with the ability to translate technical concepts for non-technical stakeholders
  • High ownership, pragmatic problem solving, and a track record of shipping reliable data systems
  • WHY JOIN US?

    We’re re-thinking the extraordinary mission to save lives! As an established e-learning company with a 25-year history of serving 4 million students, we are just getting started and we need YOU to help us DRIVE the future. Five-time Winner of Inc 5000’s Fastest Growing Companies IN AMERICA and Top 100 Fastest Growing Companies in LA are some accomplishments that make us cheer. And what really makes us proud is working with extraordinary individuals every day who are ready to help us in our mission to save lives with engaging training content. Investing into our innovation principle, we’re building a startup within our own organization to disrupt the teen driver education market and build bridges into the future of what driving will look like.

    If you’re the kind of person who never settled, has a thirst for knowledge, and loves what you do, join us! Together, let’s drive the future!

    OUR MISSION & CULTURE

    We believe in thinking differently. We believe in challenging the status quo. We believe that Good is the Enemy of Great. We had an idea 25 years ago that changed the training industry forever. The notion was simple : the more you enjoy learning, the more you’ll remember. Our training programs were created in partnership with the World-Famous Improv Comedy Club to make training Fun, Fast, and Effective. Since then, our unique edutainment courses have won copious accolades from Over 4 million students, and a number of effectiveness studies later, we’re proud to say that we were right, we do SAVE LIVES!

    We save lives through innovative safety training and education. We work with large employers, government agencies, and individuals to deliver unique E-learning programs.

    We are proud of our accomplishments as a 4-time winner of INC 5000‘s fastest-growing companies in US; Top 100 fastest growing in LA County, and we are just getting started.

    If you are a driven individual who is passionate about People, Culture, and Community and agree with the perspective below, we would love to hear from you :

  • Never Settle – You are always interested in what’s next, you celebrate your wins while exploring the next adventure.
  • T hirst for Knowledge – You love to learn and grow!
  • Love What You Do – You enjoy what you do and have fun doing it. You take enormous pride and pleasure in your work.
  • Extreme Ownership – The buck stops with you; you are a leader leading your team to success
  • In summary - If our story could be told in a fable, it would go something like this :

    A traveler came upon three men working. He asked the first man what he was doing and the man said he was laying bricks. He asked the second man the same question and he said he was putting up a wall. When he got to the third man and asked him what he was doing he said he was building a cathedral.

    If you don’t mind moving bricks to build a beautiful cathedral, we want you on our team.

    Seniority level

  • Mid-Senior level
  • Employment type

  • Full-time
  • Job function

  • Information Technology, Analyst, and Project Management
  • Industries : E-Learning Providers
  • Referrals increase your chances of interviewing at IMPROVLearning by 2x

    #J-18808-Ljbffr

    Crear una alerta de empleo para esta búsqueda

    Senior Data Engineer • Peru

    Ofertas relacionadas
    • Oferta promocionada
    Senior Backend Engineer

    Senior Backend Engineer

    RPeru
    Remote is solving modern organizations’ biggest challenge – navigating global employment compliantly with ease.We make it possible for businesses of all sizes to recruit, pay, and manage internatio...Mostrar másÚltima actualización: hace 26 días
    • Oferta promocionada
    Senior Backend Engineer (Elixir)

    Senior Backend Engineer (Elixir)

    RPeru
    Remote is solving modern organizations’ biggest challenge – navigating global employment compliantly with ease.We make it possible for businesses of all sizes to recruit, pay, and manage internatio...Mostrar másÚltima actualización: hace 22 días
    • Oferta promocionada
    Fullstack Developer Senior (Perú)

    Fullstack Developer Senior (Perú)

    Link-WorldwidePeru
    En FRACTAL, consultora de TI con más de 11 años de experiencia a nivel nacional e internacional atediendo a más de 70 clientes que confían en nosotros, nos encontramos en la búsqueda de un Fullstac...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Principal Software Development Engineer - AI Data Platform

    Principal Software Development Engineer - AI Data Platform

    OraclePeru
    Principal Software Development Engineer - AI Data Platform.Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Software Development Engineer - AI Data Platform to help global custom...Mostrar másÚltima actualización: hace 13 días
    • Oferta promocionada
    Senior Data Analyst / Data Architect

    Senior Data Analyst / Data Architect

    LunaJoy HealthPeru
    Job Title : Senior Data Analyst / Data Architect.Luna Joy is a leading provider of mental health services, specializing in supporting women through their mental wellness journey.We offer holistic th...Mostrar másÚltima actualización: hace 2 días
    • Oferta promocionada
    Java Backend Engineer - Web3 Data

    Java Backend Engineer - Web3 Data

    BinancePeru
    Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 280 million people in 100+ countrie...Mostrar másÚltima actualización: hace 2 días
    • Oferta promocionada
    Cloud Engineer with Azure or AWS, Senior Level 1

    Cloud Engineer with Azure or AWS, Senior Level 1

    GlobantPeru
    Cloud Engineer with Azure or AWS, Senior Level 1.Cloud Engineer with Azure or AWS, Senior Level 1.At Globant, we are working to make the world a better place, one step at a time.We enhance business...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    AWS DevOps Engineer - Tech Lead

    AWS DevOps Engineer - Tech Lead

    LumenaltaPeru
    AWS DevOps Engineer – Tech Lead.Join Lumenalta in building innovative digital products that impact hundreds of millions of customers, transactions, and data points. As a Tech Lead, you will design, ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Senior Backend Software Engineer - CHAOS

    Senior Backend Software Engineer - CHAOS

    Cerby Inc.Peru
    Collaborating across your apps doesn’t need to be chaos.We are a mission-critical cybersecurity company that empowers your teams to operate securely and control their apps completely.We’ve built ou...Mostrar másÚltima actualización: hace 29 días
    • Oferta promocionada
    Senior Kubernetes Developer - OPS00016

    Senior Kubernetes Developer - OPS00016

    Dev.ProPeru
    We invite a skilled Kubernetes Developer to join our fully remote, international team.In this role, you'll build and optimize the Kubernetes orchestration platform and develop custom operators to r...Mostrar másÚltima actualización: hace 20 días
    • Oferta promocionada
    LDAP Software Engineer - Peru, IN -Fulltime Role

    LDAP Software Engineer - Peru, IN -Fulltime Role

    iSoftTek Solutions IncPeru
    Work with upstream data source and downstream clients to resolve data related issues.Assist in designing, developing, and implementing Data as A Service (DaaS) and support for microservices.Assist ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Senior Frontend Engineer

    Senior Frontend Engineer

    WorkanaPeru
    Be among the first 25 applicants.This range is provided by Workana.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. This Is Not Just About Pushin...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Data Engineer + Cloud

    Data Engineer + Cloud

    DWConsulwarePeru
    DWConsulware de Perú es una consultoría de negocios especializada en Tecnologías de la Información, fundada en 1998.Somos líderes en soluciones para la administración del desempeño corporativo (CPM...Mostrar másÚltima actualización: hace 2 días
    • Oferta promocionada
    Senior Backend Engineer (AWS)

    Senior Backend Engineer (AWS)

    LumenaltaPeru
    Be among the first 25 applicants.As a Senior Backend Engineer at Lumenalta, you will design and implement robust backend systems, ensuring our applications are secure, scalable, and efficient.You w...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Full Stack Engineer – Storyblok Pro

    Full Stack Engineer – Storyblok Pro

    LumenaltaPeru
    Full Stack Engineer – Storyblok Pro.At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build c...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Azure Data Engineer

    Azure Data Engineer

    ZatPeru
    Especializados en tecnologías de la información, contamos con un sólido equipo de ingenieros liderados por expertos con más de 9 años de experiencia, enfocados en ofrecer soluciones inteligentes qu...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Senior Backend Engineer (Elixir)

    Senior Backend Engineer (Elixir)

    LogoslabsPeru
    Remote is solving modern organizations’ biggest challenge – navigating global employment compliantly with ease.We make it possible for businesses of all sizes to recruit, pay, and manage internatio...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Python Back End Developer

    Python Back End Developer

    ApplaudoPeru
    You are a highly skilled Back-End Developer who thrives on solving complex technical challenges and building scalable, high-performance systems. You enjoy working in environments where you can influ...Mostrar másÚltima actualización: hace 2 días