Senior Data Engineer

Company: Insight Global
Location: Seattle
Posted on: May 4, 2024

Job Description:

Job Description
Disney Streaming is creating digital video entertainment products for one of the largest media brands in the world, with the mission of providing consumers the ability to access content on any connected device, at any time, in any location. As we continue to use our innovative technology to deliver dynamic direct-to-consumer entertainment for millions of fans across the globe, we are looking for a Lead Data Engineer, Data Platforms who can operate across the enterprise to ensure on-time, high-quality delivery of products and features that directly drive our business.
The Activation team within Data Platforms is responsible for sharing data with internal customers and external 3rd party partners in a secure and reliable fashion, ensuing that "chain-of-custody" or our sensitive data is maintained at every step of the process.
A Lead Data Engineer is responsible for creating tools and platforms that enable this mission:
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
---------
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
*---Define, build, and execute process programs and communication strategies in collaboration with cross-functional teams
*---Create and maintain documentation and templates for key engineering processes
*---Assist enterprise-wide program roll-outs by developing training documentation and runbooks
*---Drive initiatives related to engineering and program management onboarding and process operations
*---Create and apply information architecture recommendations for engineering and product teams
*---Drive continuous improvement on existing programs and critically evaluate what is working well and what needs to be improved
*---Design table structures and define ETL strategy to build performant Data solutions that are reliable and scalable in a fast growing data ecosystem.
*---Develop Data Quality checks for source and target data sets. Develop UAT plans and conduct QA.
*---Develop and maintain ETL routines using ETL and orchestration tools such as Airflow, Luigi and Jenkins.
*---10+ years of relevant Professional experience.
*---10+ years experience using analytic SQL, working with traditional relational databases and/or distributed systems such as Hadoop / Hive, BigQuery, Snowflake/Redshift.
*---10+ Years of experience programming languages (e.g. Python, Java, Scala, bash) preferred.
*---Experience in Cluster Platform, especially EKS or Databricks preferred.
*---2+ Experience in AWS Cloud Platform - AWS methodologies
*---2+ years of experience with workow management tools (Airow, Oozie, Azkaban, UC4)
*---Good understanding of SQL Engines and able to conduct advanced performance tuning
*---Strong communication skills -- written and verbal presentations.
*---Excellent conceptual and analytical reasoning competencies.
*---Degree in an analytical field such as economics, mathematics, or computer science is desired. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Keywords: Insight Global, Seattle Hill-Silver Firs , Senior Data Engineer, Engineering , Seattle, Washington