Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

1NMC data pipeline architecture

prepared for the visit of John Tavolieri is Israel, October 2017
by

Idan Mittelpunkt

on 15 February 2018

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of 1NMC data pipeline architecture

frontend
backend
applications
collection-segmentation-syndication
processing-storage
querying-analysis
Offline
Data Out
RDR
NMC
APP
Business
Intelligence
BILLING
VARIOUS
REPORTS
DATA
SCIENCE
BUSINESS
CONFIGURATION
profile repository
data serving
modeling&scoring
DMP
Service
Profile
Service
NBI
Service
infrastructure
middleware
infrastructure
frontend
APP
DMP
APP
Profile
APP
NBI
CDN
questions ?
thank you !
http(s)
uReplicator
8B US devices
3B EU devices
online
offline
1.7T models/day
1100 models/call
less than 20ms
50 r4.4xlarge
5 EBS x 3TB
72 hours retention
>1000 partitions/topic

> 10 topics
> 20 consumers
~10 on 1 big topic
~11B events/day
15TB/day
parquet
11B events/day
5B events/day
200 MS SLA
10 B/day
Full transcript