Solutions
Pricing
Log in
Teams
Get started
Log in
Get started
4.3 EDM Plan Overview
SR
by
Sean Reynolds
·
3 views
·
Updated Mar 1, 2021
Share
Embed
Re-use content
Create your own
Chapters
00:00
Chapter 1
00:16
Chapter 2
01:01
Chapter 3
02:59
Chapter 4
04:26
Chapter 5
06:30
Chapter 6
Audio Transcript
Auto-generated
00:02 - 00:02
well, everyone.
00:03 - 00:05
My name is Sean Reynolds and welcome back to our
00:05 - 00:08
discussions surrounding big data at Comcast today.
00:08 - 00:10
We're going to go over our Enterprise data management plan
00:11 - 00:14
and the ML voice reporting project.
00:16 - 00:18
Let's get started on the next slide with an overview
00:18 - 00:23
of today's discussion as we look at our past big
00:23 - 00:25
data initiatives and begin to gaze onwards to R E.
00:25 - 00:28
D M Future State, the machine learning voice team at
00:28 - 00:32
Comcast has developed a plan to recap.
00:33 - 00:35
What we've discussed in prior meetings are EDM Team will
00:36 - 00:38
help the ML voice group provide downstream users the means
00:39 - 00:40
to query more enlightening information.
00:41 - 00:44
In order to train our AI model, The following slides
00:45 - 00:49
will address our DW architecture enterprise scale, some of the
00:49 - 00:52
staffing requirements for the overall project as well as a
00:52 - 00:57
cost analysis and two different requirements necessary to attain a
00:57 - 00:58
more robust solution.
00:59 - 00:59
Moving forward.
01:01 - 01:06
Let's start by looking at the Kimble Lifecycle before we
01:06 - 01:07
discuss this further.
01:07 - 01:09
Let's talk about the six phases.
01:12 - 01:16
These six phases will help us two address some of
01:17 - 01:18
the pre work prior to the Kimble lifecycle.
01:20 - 01:24
This includes addressing urgent current state issues, defining the first
01:24 - 01:28
version of the ADM Future state conducting a stakeholder summit
01:28 - 01:28
for Mitt engagement.
01:29 - 01:32
Feedback. Adjusting the ADM future state is necessary.
01:33 - 01:36
Building the faced roadmap from the current state to the
01:36 - 01:38
future state and then executing the road map.
01:39 - 01:43
The Kimball Life cycle is going to take place during
01:44 - 01:45
the roadmap execution phase.
01:47 - 01:51
The figure here acts as an overview describing the entirety
01:51 - 01:55
of the project and how the project flows between the
01:55 - 01:56
different requirements.
01:57 - 02:01
Firstly being the business requirements definition where the project is
02:01 - 02:06
defined and then moving into three separate tracks shown in
02:06 - 02:11
the middle as technical architecture design, dimensional modeling, FBI application
02:13 - 02:17
These three tracks make up the entirety of the D
02:17 - 02:18
W architecture.
02:20 - 02:27
Our technical architecture design includes some of the processes we
02:27 - 02:28
will use to collect data.
02:29 - 02:31
How that data is stored and how that data is
02:31 - 02:34
sourced as mentioned previously are suggested.
02:34 - 02:39
Architecture follows the mic to incremental design process which stands
02:39 - 02:41
for method for an integrated knowledge environment.
02:42 - 02:45
We will continue to define data sources and target tables
02:46 - 02:49
and our dimensional design worksheet in the dimensional modeling track.
02:50 - 02:54
And lastly RB application will include the Amazon redshift e
02:54 - 02:57
T. O Toole connected to our s three Data Lakes.
02:59 - 03:03
As the project progresses, let's talk about our staffing play.
03:05 - 03:07
We have different roles here shown in the table below,
03:09 - 03:13
including business sponsors, the APP, designers, data architects and database
03:14 - 03:18
administrators, E T l architects and metadata coordinators.
03:21 - 03:24
We can't anticipate having about four business sponsors from different
03:25 - 03:25
cross functional groups.
03:26 - 03:30
These will likely be VPs from the machine Learning team
03:30 - 03:33
and three other downstream teams that will help to advocate
03:33 - 03:33
the project.
03:35 - 03:37
We'll also look for the APP designers that are certified
03:38 - 03:41
in Amazon Web services and that have previous experience with
03:42 - 03:42
Red Shift.
03:43 - 03:48
Then we'll look for data architects that will eventually phase
03:48 - 03:49
into Deba roles.
03:51 - 03:53
These individuals will help us to normalize our models.
03:55 - 03:57
Then we will look for retail designers that will help
03:58 - 03:59
us with all of the detail processes.
04:01 - 04:05
Although the first portion of our project is likely to
04:05 - 04:10
be around one year, we will keep the et al
04:10 - 04:14
architects on most likely for the entirety of the E.
04:14 - 04:18
D. M project, which is three plus years, and lastly
04:18 - 04:22
we'll have metadata coordinators that are going to initially tag
04:22 - 04:25
and manipulate the user data to help us with the
04:25 - 04:31
GTL process The main focus for our cost analysis is
04:32 - 04:35
going to be with regards to staffing, seeing that most
04:35 - 04:38
of the source systems and tools are already in place.
04:40 - 04:43
The main focus is determining our project's success in determining
04:44 - 04:44
our project.
04:44 - 04:49
Success is the stakeholders satisfaction and the financial improvements made
04:50 - 04:52
to our storage and maintenance of the ADM Future state
04:53 - 04:56
Using the staffing matrix in the previous slide, we estimate
04:57 - 05:00
the staffing and consulting fees in the first year to
05:00 - 05:02
be around $1.5 million.
05:03 - 05:06
Next, our project is anticipated to last around 3 to
05:06 - 05:11
4 years, with machine learning reporting being complete in the
05:11 - 05:11
first year.
05:12 - 05:15
Staffing, or ADM initiative, with the proper personnel over the
05:15 - 05:18
course of several years, takes a partnership between human resources,
05:19 - 05:22
C level executives and many cross functional groups that are
05:22 - 05:24
temporarily assigned to the project.
05:28 - 05:30
One of the main objectives of the D M project
05:30 - 05:33
is to lower development costs for machine learning and AI
05:33 - 05:36
models, which is going to be achieved through our increased
05:37 - 05:40
speed and data reliability in our production environment.
05:42 - 05:45
The production team often waits to iterate the project further
05:45 - 05:50
until downstream teams can help them to run analysis on
05:51 - 05:59
the current state of user input medium project costs associated
05:59 - 06:00
with migrating.
06:00 - 06:04
Our data will be offset by the savings in minimizing
06:05 - 06:08
the diva is required for server maintenance and ad hoc
06:09 - 06:13
reporting. Some of the other cost factors in how the
06:13 - 06:17
team plans to use Amazon Redshift is the cost of
06:17 - 06:23
using $4 per terabyte of scanned data, which equates to
06:23 - 06:26
approximately $4000 in daily analytical processing.
06:31 - 06:34
And moving on to the conclusion, which is the overall
06:34 - 06:38
benefit of the idiom project is going to be to
06:38 - 06:41
assist the larger enterprise and providing cross functional reporting capabilities
06:42 - 06:42
to downstream users.
06:44 - 06:47
The machine learning team is expected to save approximately $500,000
06:48 - 06:54
annually due to the inefficiencies of moving, storage and online
06:54 - 06:57
processing to an entirely cloud based environment.
06:59 - 07:01
We appreciate your time and thank you for giving us
07:01 - 07:02
the opportunity to present today
See full transcript