Lead Data Engineer chez DISNEY Skip Navigation
EN
Rechercher des emplois
The Walt Disney Company: Be Part of the Story

Be Part of the Story

Lead Data Engineer

Postuler maintenant Postuler ultérieurement Job ID 862612BR Emplacement New York, New York, États-Unis Entreprise Marvel Entertainment Date de publication 14/09/2021

Résumé du poste:

Marvel is seeking an experienced AWS Cloud Data Engineer with significant DevOps and SysOps experience. The company is headquartered in NYC, but this role is envisioned as a remote position and will focus on providing engineering support for a variety of analytics, data architecture and data science endeavors.

In this role you will primarily lead the design and evolution of the BI data lake, while working closely with the rest of the BI team to build a flexible and robust data infrastructure.

You will co-develop and maintain an evolving number of data pipelines to enable advanced reporting capabilities across our Subscription, Publishing, Digital, Consumer Products, Corporate and Marketing teams. This role will function as Marvel’s primary subject matter expert on creating and maintaining efficient data pipelines to clean, conform and deliver large datasets, both structured and unstructured, to downstream destinations.

As the team’s ETL expert, there will be ample opportunities to conduct complex data wrangling/munging operations using a variety of AWS and other industry standards tools including, Python, Pandas, PySpark, Glue Studio, Lambdas, Advanced SQL, etc. You will also work with APIs, create complex materialized views and scheduled queries, as well as develop error logging routines and associated alerts. You can expect to work closely with the Enterprise Architect and Data Architect to design and deploy best practice data governance operations as well.

Our team is small but capable, and looking for an intellectually curious engineer with excellent communication skills, who is interested in working very closely to co-invent solutions to complex problems. Our department is also an environment that encourages constantly learning and cross-functional growth, so you can expect to explore and expand your knowledge in areas like supervised and unsupervised machine learning, graph databases, AI and applied statistics/mathematics.

Responsabilités:

  • Develop batch and real-time data pipelines, and lead the integration of Marvel’s many 1st, 2nd, and 3rd party data sources, while working closely with other engineering services such as the personalization and testing teams.
  • Create data catalogs and validation routines to ensure quality and correctness of key operational datasets and metrics in real time.
  • Build integrations with organic and paid media platforms to effectively deliver data to support the optimization of various KPIs.
  • Partner with Data Architect to build data infrastructure that enables activation, attribution and segmentation capabilities across growth, retention and marketing objectives
  • Collaborate with lifecycle and product marketing teams to democratize insights that will drive subscriber engagement using data driven solutions.
  • Coach other engineers and BI team members on best practices and technical concepts of building large scale, robust and well governed data platforms.

Qualifications Nécessaires:

  • Excellent communicator and collaborator, able to apply technical acumen to drive business outcomes.
  • A natural team player with a willingness and desire to engage in cross training in a small team environment.
  • 4+ years in big data and/or data intensive projects in industry or academic/research settings
  • 4+ years of deep experience developing in Python
  • Expert Level SQL developer – with an emphasis on Redshift but capable across multiple other transactional databases such as PostgreSQL, MySQL, Mongo dB, etc.
  • Significant experience developing with PySpark
  • Experience engineering big-data solutions using technologies like Redshift, Spark, S3, DynamoDB, Glue Studio and AWS SageMaker, Glue Studio, SageMaker Data Wrangler, etc.
  • Demonstrated understanding of data engineering tools and practices, including platforms like Airflow, Databricks, Snowflake, and Jenkins
  • Experience with deploying and running AWS-based data solutions and comfortable deploying tools such as Cloud Formation, AWS Glue, Kinesis, DynamoDB, Athena and Lambda
  • Demonstrated experience applying Master Data Management including metadata management, data lineage, and the principles of data governance
  • Ability to deliver technical solutions in the face of challenging data conditions.

Compétences Souhaitées:

  • Experience implementing marketing technology stacks including real-time messaging and attribution pipelines.
  • Experience leveraging DMPs (BlueKai) and CDPs (mParticle, Segment) to create deterministic user profiles that can be leveraged across a variety of applications.
  • Experience integrating with ML platforms and experimentation frameworks.
  • Familiarity with front-end development frameworks and experience in full stack development a plus.
  • An experimental and autodidactic mind set towards expanding your own capabilities.
  • Familiarity with binary data serialization formats such as Parquet, Avro, and Thrift.

Formation Requise:

BA / BS Degree or relevant work experience.

Sur Marvel Entertainment:

Marvel Entertainment, LLC, filiale en propriété exclusive de The Walt Disney Company, est l’une des sociétés de divertissement les plus renommées au monde, basée sur une bibliothèque éprouvée de plus de 8 000 personnages qui figurent dans divers médias depuis plus de soixante-dix ans. Marvel utilise ses franchises de personnages dans les divertissements, les licences et la publication.

Sur The Walt Disney Company:

The Walt Disney Company, avec ses filiales et ses sociétés affiliées, est une grande société internationale et diversifiée de divertissement familial et de médias couvrant les secteurs d’activités suivants : réseaux de médias, parcs et centres de vacances, studio de divertissements, produits de consommation et médias interactifs. Depuis ses modestes débuts en tant que studio de dessins animés dans les années 20 jusqu’à son statut de référence dans l’industrie du divertissement d’aujourd’hui, Disney poursuit fièrement sa tradition de création d’histoires et d’expériences exceptionnelles pour tous les membres de la famille. Les histoires, les personnages et les expériences de Disney touchent les consommateurs et les visiteurs du monde entier. À travers nos activités présentes dans plus de 40 pays, nos employés et cast members collaborent pour créer des expériences de divertissement appréciées à la fois au niveau universel et local.

Le poste est rattaché à Marvel Entertainment, LLC , qui fait partie du secteur d’activité que nous appelons Marvel Entertainment.

Marvel Entertainment, LLC est un employeur qui souscrit au principe d’égalité des chances. Les candidat(e)s seront pris(es) en considération pour l’emploi sans considération de race, de couleur, de religion, de sexe, d’origine nationale, d’orientation sexuelle, d’identité sexuelle, de handicap ou de statut d’ancien combattant protégé. Disney favorise une culture commerciale où les idées et décisions de tous et toutes nous aident à grandir, innover, créer les meilleures histoires et être pertinents dans un monde en évolution rapide.

Postuler maintenant Postuler ultérieurement

Abonnez-vous à nos alertes d'offres d'emploi

Inscrivez-vous pour recevoir de nouvelles alertes d’emploi et des informations sur notre société selon vos préférences.

Specify LocationsCoordonnées