4.3 EDM Plan Overview

SR
by Sean Reynolds3 views·Updated Mar 1, 2021

Chapters

Audio TranscriptAuto-generated

  1. well, everyone.
  2. My name is Sean Reynolds and welcome back to our
  3. discussions surrounding big data at Comcast today.
  4. We're going to go over our Enterprise data management plan
  5. and the ML voice reporting project.
  6. Let's get started on the next slide with an overview
  7. of today's discussion as we look at our past big
  8. data initiatives and begin to gaze onwards to R E.
  9. D M Future State, the machine learning voice team at
  10. Comcast has developed a plan to recap.
  11. What we've discussed in prior meetings are EDM Team will
  12. help the ML voice group provide downstream users the means
  13. to query more enlightening information.
  14. In order to train our AI model, The following slides
  15. will address our DW architecture enterprise scale, some of the
  16. staffing requirements for the overall project as well as a
  17. cost analysis and two different requirements necessary to attain a
  18. more robust solution.
  19. Moving forward.
  20. Let's start by looking at the Kimble Lifecycle before we
  21. discuss this further.
  22. Let's talk about the six phases.
  23. These six phases will help us two address some of
  24. the pre work prior to the Kimble lifecycle.
  25. This includes addressing urgent current state issues, defining the first
  26. version of the ADM Future state conducting a stakeholder summit
  27. for Mitt engagement.
  28. Feedback. Adjusting the ADM future state is necessary.
  29. Building the faced roadmap from the current state to the
  30. future state and then executing the road map.
  31. The Kimball Life cycle is going to take place during
  32. the roadmap execution phase.
  33. The figure here acts as an overview describing the entirety
  34. of the project and how the project flows between the
  35. different requirements.
  36. Firstly being the business requirements definition where the project is
  37. defined and then moving into three separate tracks shown in
  38. the middle as technical architecture design, dimensional modeling, FBI application
  39. These three tracks make up the entirety of the D
  40. W architecture.
  41. Our technical architecture design includes some of the processes we
  42. will use to collect data.
  43. How that data is stored and how that data is
  44. sourced as mentioned previously are suggested.
  45. Architecture follows the mic to incremental design process which stands
  46. for method for an integrated knowledge environment.
  47. We will continue to define data sources and target tables
  48. and our dimensional design worksheet in the dimensional modeling track.
  49. And lastly RB application will include the Amazon redshift e
  50. T. O Toole connected to our s three Data Lakes.
  51. As the project progresses, let's talk about our staffing play.
  52. We have different roles here shown in the table below,
  53. including business sponsors, the APP, designers, data architects and database
  54. administrators, E T l architects and metadata coordinators.
  55. We can't anticipate having about four business sponsors from different
  56. cross functional groups.
  57. These will likely be VPs from the machine Learning team
  58. and three other downstream teams that will help to advocate
  59. the project.
  60. We'll also look for the APP designers that are certified
  61. in Amazon Web services and that have previous experience with
  62. Red Shift.
  63. Then we'll look for data architects that will eventually phase
  64. into Deba roles.
  65. These individuals will help us to normalize our models.
  66. Then we will look for retail designers that will help
  67. us with all of the detail processes.
  68. Although the first portion of our project is likely to
  69. be around one year, we will keep the et al
  70. architects on most likely for the entirety of the E.
  71. D. M project, which is three plus years, and lastly
  72. we'll have metadata coordinators that are going to initially tag
  73. and manipulate the user data to help us with the
  74. GTL process The main focus for our cost analysis is
  75. going to be with regards to staffing, seeing that most
  76. of the source systems and tools are already in place.
  77. The main focus is determining our project's success in determining
  78. our project.
  79. Success is the stakeholders satisfaction and the financial improvements made
  80. to our storage and maintenance of the ADM Future state
  81. Using the staffing matrix in the previous slide, we estimate
  82. the staffing and consulting fees in the first year to
  83. be around $1.5 million.
  84. Next, our project is anticipated to last around 3 to
  85. 4 years, with machine learning reporting being complete in the
  86. first year.
  87. Staffing, or ADM initiative, with the proper personnel over the
  88. course of several years, takes a partnership between human resources,
  89. C level executives and many cross functional groups that are
  90. temporarily assigned to the project.
  91. One of the main objectives of the D M project
  92. is to lower development costs for machine learning and AI
  93. models, which is going to be achieved through our increased
  94. speed and data reliability in our production environment.
  95. The production team often waits to iterate the project further
  96. until downstream teams can help them to run analysis on
  97. the current state of user input medium project costs associated
  98. with migrating.
  99. Our data will be offset by the savings in minimizing
  100. the diva is required for server maintenance and ad hoc
  101. reporting. Some of the other cost factors in how the
  102. team plans to use Amazon Redshift is the cost of
  103. using $4 per terabyte of scanned data, which equates to
  104. approximately $4000 in daily analytical processing.
  105. And moving on to the conclusion, which is the overall
  106. benefit of the idiom project is going to be to
  107. assist the larger enterprise and providing cross functional reporting capabilities
  108. to downstream users.
  109. The machine learning team is expected to save approximately $500,000
  110. annually due to the inefficiencies of moving, storage and online
  111. processing to an entirely cloud based environment.
  112. We appreciate your time and thank you for giving us
  113. the opportunity to present today