Table of Contents ● What is Data Engineering? ● Data Warehouse Deep Dive ● Redshift Introduction ● How to Access Redshift ● Data Management Best Practices ● Launch Redshift Cluster ● Lab Session and Assignment

Why do customers churn after 2 to 3 months?

Churn Rate, also known as the rate of attrition or customer churn, is the rate at which customers stop doing business with an entity

Troubleshooting Calls and Churn

• 서비스 관련해서 트러블슈팅 전화를 하는 고객들의 Churn rate은 어떨까?

  가입 해지율 (Churn rate)

  • Survivor Bias & Confirmation Bias

    

  • 다양한 각도에서 데이터를 바라봐야 한다

Different Roles

• Data Warehouse 관리

• 데이터 파이프라인 작성 및 관리

  • Data Pipeline == ETL (Extract, Transform and Load) == Data Job == DAG

• Types of Data Pipelines

  • Batch Processing vs. Realtime Processing
  • Data Generation 요약 (DBT - Analytics Engineer)

• Event Collection

  • User’s behavioral data

• 나아갈 수 있는 길 : ML Engineer, MLOps, Privacy Engineer, Analytics Engineer

  

Skillset

• SQL: Hive, Presto, SparkSQL, ...
• Programming Language : Python/Scala/Java
• ETL/ELT Scheduler : Airflow, …
• 대규모 컴퓨팅 플랫폼 : Spark/YARN